-- Logs begin at Thu 2022-07-14 13:32:07 UTC, end at Thu 2022-07-14 14:55:13 UTC. -- Jul 14 14:21:36.522940 dv-cinder-799871-30-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 14:21:36.532163 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 14:21:36.534139 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 14:21:36 2022] *** Jul 14 14:21:36.534139 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 14:21:36.534139 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 14:21:36.534139 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: nodename: dv-cinder-799871-30-iscsi Jul 14 14:21:36.534139 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: machine: x86_64 Jul 14 14:21:36.534139 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: clock source: unix Jul 14 14:21:36.534139 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: pcre jit disabled Jul 14 14:21:36.534139 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: detected number of CPU cores: 4 Jul 14 14:21:36.534139 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: current working directory: / Jul 14 14:21:36.534139 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: detected binary path: /usr/bin/uwsgi-core Jul 14 14:21:36.534139 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: your processes number limit is 47680 Jul 14 14:21:36.534139 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: your memory page size is 4096 bytes Jul 14 14:21:36.534139 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: detected max file descriptor number: 2048 Jul 14 14:21:36.534139 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: lock engine: pthread robust mutexes Jul 14 14:21:36.534139 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: thunder lock: enabled Jul 14 14:21:36.534139 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 14:21:36.534139 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 14:21:36.577966 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: Python main interpreter initialized at 0x5608dd1eb9c0 Jul 14 14:21:36.577966 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: python threads support enabled Jul 14 14:21:36.577966 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: your server socket listen backlog is limited to 100 connections Jul 14 14:21:36.577966 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: your mercy for graceful operations on workers is 90 seconds Jul 14 14:21:36.578328 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 14:21:36.578403 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: *** Operational MODE: preforking *** Jul 14 14:21:36.578649 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: *** uWSGI is running in multiple interpreter mode *** Jul 14 14:21:36.578649 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: spawned uWSGI master process (pid: 103720) Jul 14 14:21:36.578854 dv-cinder-799871-30-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 14:21:36.581098 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: spawned uWSGI worker 1 (pid: 103721, cores: 1) Jul 14 14:21:36.581098 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: spawned uWSGI worker 2 (pid: 103722, cores: 1) Jul 14 14:21:36.581098 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 14:21:37.242804 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 14:21:37.259878 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 14:21:38.381560 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:21:38.381560 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: from cryptography.utils import int_from_bytes Jul 14 14:21:38.382257 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:21:38.382257 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: from cryptography.utils import int_from_bytes Jul 14 14:21:38.382374 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:21:38.382374 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: from cryptography.utils import int_from_bytes Jul 14 14:21:38.382780 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:21:38.382780 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: from cryptography.utils import int_from_bytes Jul 14 14:21:40.914348 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 14:21:40.914931 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 14:21:40.915123 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 14:21:40.915486 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 14:21:40.915742 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 14:21:40.916131 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.916510 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.916829 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.917150 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.917479 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.917825 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.918154 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.918475 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.918802 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.919065 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.919410 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.919526 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 14:21:40.919876 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-30-iscsi {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.919975 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 14:21:40.920056 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.920287 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 14:21:40.920395 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.920600 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.920687 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 14:21:40.920888 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 14:21:40.920974 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.921275 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.921369 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.921599 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.921686 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.921926 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.922027 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.922272 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.922445 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.922835 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.922978 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.923094 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.923215 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.923320 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.923466 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.923581 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.923838 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.923990 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.924123 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.924208 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.924441 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.924650 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.924740 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.924980 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-30-iscsi {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.925083 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.925303 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.925389 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.925614 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.925711 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.925950 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.926051 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-30-iscsi {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.926267 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.926355 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.926572 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.926669 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.926891 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.926988 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.927195 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.927359 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.927669 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.927754 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.927979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.928076 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.928296 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.928469 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.928604 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.928691 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.929431 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.929531 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.929749 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.929875 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.930085 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.930178 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.930403 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.930551 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.930707 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.930796 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.931027 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.931122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.931333 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.931434 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.931639 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.931738 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-30-iscsi {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.931960 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.932056 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.932265 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.932352 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.932569 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.932663 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.932821 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.933048 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.933145 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.933327 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.933435 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.933635 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.933737 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.933982 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.934075 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.934304 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.934411 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.934567 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.934672 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.934883 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.934971 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.935202 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.935291 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.935509 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.935623 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.935817 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.935907 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.936117 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.936203 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.936422 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.936522 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.936728 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.936826 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.937028 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.937127 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.937334 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.937421 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.937638 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.937724 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.937912 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.938012 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.938221 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.938308 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.938539 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.938634 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.938859 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.938955 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.939177 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.939267 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.939573 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.939678 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.939822 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.939920 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.940130 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.940225 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.940449 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.940546 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.940758 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.940853 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.941063 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.941157 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.941367 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.941454 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.941680 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.941796 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.942017 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.942117 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.942322 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.942410 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.942630 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.942719 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.942937 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.943033 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.943256 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.943352 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.943557 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.943643 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.943808 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.943895 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.944114 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.944210 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.944475 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.945135 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.945317 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.945421 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.945625 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.945722 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.945991 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.946092 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.946373 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.946474 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.946567 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.946664 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.947838 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.947953 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.948049 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.948132 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.949634 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.949745 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.949889 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.949971 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.950051 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.950129 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.950224 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.950307 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.950386 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.951537 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.951625 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.951715 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.951808 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.951890 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.951969 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.952055 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.952136 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.952215 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.952307 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.952389 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.952532 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.952625 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.952747 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.952880 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.952981 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.953062 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.953062 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.953304 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.953393 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.953489 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.953578 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.953660 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.953747 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.953883 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.953963 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.954061 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.954143 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.954280 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.954365 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.954498 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.954589 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.954679 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.954799 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.954910 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.954998 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.955074 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.955142 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.955351 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.955438 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.955565 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.955648 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.955778 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.955870 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.956002 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.956133 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.956217 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.956342 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.956458 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.956591 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.956683 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.956772 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.956852 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.956930 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.957047 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.957152 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.957248 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.957339 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.957420 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.957545 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.957628 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.957811 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.957906 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.958131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.958223 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.958434 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.958571 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.958738 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.958868 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.959103 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.959220 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.959407 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.959494 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.959783 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.959889 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.960043 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.960128 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.960345 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.960461 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.960648 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.960736 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.960950 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.961039 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.961255 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.961354 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.961555 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.961645 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.961883 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.961974 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.962188 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.962294 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.962491 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.962588 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.962787 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.962906 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.963102 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.963202 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.963419 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.963506 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.963723 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.963817 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.964027 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.964128 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.964330 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.964417 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.964644 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:21:40.964734 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.964970 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.965087 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.965286 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.965371 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.965593 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.965679 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.965946 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.966059 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.968187 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.968325 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.968418 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.968499 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.968605 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.968699 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.968780 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.968866 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.968946 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.969025 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.969117 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.969199 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.969277 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.969361 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.969441 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.969520 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.969607 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.969688 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.969823 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.969907 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.970000 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.970081 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.970169 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.970300 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.970389 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.970514 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.970602 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.970691 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.971050 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.971158 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.971240 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.971519 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.971634 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.971791 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.971881 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.972106 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.972196 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.972413 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.972520 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.972723 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.972811 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.973059 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.973154 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.973373 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.973460 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.973692 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.973806 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.974033 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.974121 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.974341 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.974441 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.974651 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.974741 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.974957 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.975086 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.975265 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.975364 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.975589 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.975680 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.975894 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.975981 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.976217 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.976387 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.976527 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.976616 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.976836 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.976923 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.977142 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.977239 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.977450 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.977540 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.977756 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.977903 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.978111 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.978209 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.978418 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.978505 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.978727 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.978815 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.979034 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.979121 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.979340 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.979425 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.979644 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.979731 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.979956 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.980267 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.980568 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.980888 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.981202 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.981507 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.981849 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.982157 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.982459 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.982551 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.982774 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.982866 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.983084 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.983189 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.983393 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.983495 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.983836 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.984133 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.984392 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.984479 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.984968 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.985188 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.985270 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.985363 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.985445 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.985445 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.985588 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.985666 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.985907 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.986011 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.986238 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.986354 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.986560 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.986655 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.986874 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.986972 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.987174 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.987262 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.987481 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.987582 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.987781 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.987870 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.988137 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.988507 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.988764 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.988927 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.989099 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.989408 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.989493 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.989714 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.990072 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.990173 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.990348 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.990429 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.990651 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.990730 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.990972 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.991050 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.991803 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.991890 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.992106 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.992183 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.992406 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.992493 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.992707 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.992809 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.993049 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.993225 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.993354 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.993547 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.993971 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.994252 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.994328 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.994408 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.994517 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.994611 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.994720 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.994840 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.995032 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.995184 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.995350 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.995518 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.995660 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.995826 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.995969 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.996151 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.996277 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.996475 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.996586 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.996790 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.996905 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.997095 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.997216 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.997404 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.997576 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.997707 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.997863 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.998054 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.998187 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.998357 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.998497 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.998663 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.998815 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.998962 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.999117 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.999265 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.999432 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.999566 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.999769 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:40.999860 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.000100 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.000186 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.000416 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.000493 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.000737 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.000822 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.001032 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.001108 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.001331 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.001422 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.001629 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.002033 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.002033 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.002170 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.002251 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.002322 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.002549 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.002636 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.002866 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.002950 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.003173 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.003249 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.003493 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.003598 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.003802 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.003890 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.004113 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.004188 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.004418 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.004495 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.004722 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.004798 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.005046 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.005138 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.005522 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.005605 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.005896 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.006130 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.006228 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.006462 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.006562 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.006818 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.006939 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.007712 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.007854 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.008021 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.008126 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.008329 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.008417 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.008637 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.008724 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.008940 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.009097 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.009245 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.009416 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.009552 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.009756 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.009886 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.010110 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.010200 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.010428 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.010515 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.010747 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.010845 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.011056 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.011145 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.011360 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.011454 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.011663 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.011763 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.011965 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.012053 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.012268 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.012354 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.012573 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.012662 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.012877 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.012963 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.013180 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.013274 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.013493 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.013582 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.013812 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.014071 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.014161 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.014424 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.014524 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.014737 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.014838 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.015034 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.015180 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.015337 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.015439 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.015638 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.015727 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.015966 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.016053 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.016274 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.016369 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.016576 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.016664 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.016890 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.016977 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.017211 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.017300 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.017515 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.017601 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.017845 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.019675 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.019675 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.019965 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.020048 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.020116 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.020193 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.020283 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.020374 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.020455 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.020532 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.020610 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.020688 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.020688 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.020840 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.020919 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.021008 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.021089 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.021168 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.021168 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.021327 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.021416 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.021497 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.021575 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.021653 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.021740 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.021898 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.022008 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.022163 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.022318 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.022409 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.022663 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.022753 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.023019 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.023246 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.023341 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.023576 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.023672 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.023887 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.023976 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.024243 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.024337 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.024596 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.024685 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.024905 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.025001 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.025208 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.025336 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.025507 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.025595 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.025867 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.025961 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.026178 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.026277 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.026478 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.026574 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.026786 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.026872 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.027088 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.027175 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.027395 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.027527 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.027719 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.027807 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.028024 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.028111 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.028330 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.028561 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.028649 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.028875 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.028983 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.029181 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.029384 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.029535 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.029736 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.029915 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.030060 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.030203 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.030366 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.030510 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.030682 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.030769 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.030993 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.031082 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.031322 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.031424 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.031627 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.031716 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.031932 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.032020 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.032232 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.032329 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.032537 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.032623 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.032841 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.032937 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.033183 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.033399 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.033525 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.033831 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.033932 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.034198 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.034277 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.034572 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.034708 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.034841 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.034920 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.035146 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.035222 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.035467 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.035566 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.035765 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.035852 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.036070 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.036161 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.036442 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.036538 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.036770 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.036856 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.037077 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.037200 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.037381 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.037548 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.037692 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.037961 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.038130 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.038315 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.038407 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.038642 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.038736 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.038942 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.039045 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.039248 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.039414 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.039549 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.039808 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.039901 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.040151 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.040238 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.040453 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.040544 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.040753 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.040919 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.041059 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.041317 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.041407 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.041649 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.041737 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.050295 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.050518 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.050518 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.050518 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.050518 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.050861 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.050861 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.051024 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.051103 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.051188 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.051269 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.051348 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.051439 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.051439 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.051593 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.051672 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.051740 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.051820 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.051911 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.051993 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.052071 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.052157 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.052245 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.052334 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.052415 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.052493 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.052578 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.052658 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.052736 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.052823 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.052908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.052987 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.053055 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.053121 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.053186 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.053260 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.053329 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.053404 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.053472 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.053550 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.053628 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.054273 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.054361 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.054442 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.054522 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.054589 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.054669 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.054751 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.054751 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.054895 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.054973 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.055051 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.055159 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.055302 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.055448 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.055448 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.055632 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.055705 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.055785 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.055855 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.055921 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.055986 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.056063 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.056263 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.056343 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.056413 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.056479 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.056545 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.056610 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.056689 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.056757 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.056823 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.056888 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.056953 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.057018 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.057091 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.057167 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.057235 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.057308 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.057383 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.057452 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.057526 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.057601 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.057668 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.057733 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.057846 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.057916 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.057991 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.058080 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.058149 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.058149 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.058265 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.058330 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.058403 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.058471 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.058542 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.058610 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.058675 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.058749 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.058749 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.058914 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.058992 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.059058 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.059133 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.059208 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.059681 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.059799 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.059905 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.060029 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.060137 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.060255 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.060362 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.060565 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.060689 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.060875 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.061521 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.061612 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.061692 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.061806 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.061889 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.061984 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.062096 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.062184 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.062408 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.062536 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.062760 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.062945 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.063125 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.063344 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.063441 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.063653 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.063959 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.064263 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.064584 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.064890 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.065191 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.065491 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.065853 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.066236 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.066383 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.066628 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.066983 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.067288 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.067758 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.068331 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.068873 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.069443 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.070517 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.070972 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.071150 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.071409 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.071576 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.071971 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.073239 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.073351 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.073351 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.075007 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.075007 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.075199 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.075283 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.075283 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.075449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.075449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.075615 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.075696 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.075775 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.076839 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.076989 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.076989 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.076989 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.076989 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.077393 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.077515 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.077623 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.077729 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.077729 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.077979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.078094 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.078213 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.078344 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.078482 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.078482 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.078682 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.078682 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.078893 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.079007 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.079114 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.079227 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.079344 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.079458 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.079574 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.079683 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.079788 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.079891 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.080004 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.080124 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.080231 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.080337 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.080548 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.080665 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.080925 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.081083 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.081234 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.081410 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.081614 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.081730 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.082700 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.082892 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.082892 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.083110 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.083224 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.083331 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.083451 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.083561 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.083666 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.083866 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.084024 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.084285 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.084413 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.084626 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.084751 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.088341 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.088341 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.088341 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.088341 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.088341 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.088341 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.088341 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.088341 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.089569 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.089569 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.089569 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.090003 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.090144 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.090456 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.090769 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.091331 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.091775 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.092105 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.092537 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.092897 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.093225 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.093650 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.094000 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.094342 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.094721 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.095047 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.095224 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.095392 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.095576 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.095734 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.095925 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.096072 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.096247 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.096400 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.096544 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.096749 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.096852 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.096944 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.097156 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.097271 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.097468 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.097598 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.097785 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.097972 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.098114 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.098300 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.098608 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.098770 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.098940 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.099097 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.099246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.099411 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.099628 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.099766 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.099942 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.100200 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.100290 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.100594 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.100790 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.100918 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.101252 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.101372 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.101682 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.102012 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.102105 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.102347 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.102569 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.102680 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.103074 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.103227 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.103499 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.103814 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.103988 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.104295 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.104395 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.104670 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.104757 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.110165 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.110329 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.110411 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.110491 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.110596 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.110690 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.110770 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.110770 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.110908 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.110984 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.111060 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.111130 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.111196 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.111261 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.111341 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.111466 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.111561 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.111630 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.111697 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.111763 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.111846 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.111915 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.111990 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.112058 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.112131 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.112198 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.112273 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.112349 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.112417 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.112483 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.112549 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.112614 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.112689 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.112765 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.112833 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.112941 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.113031 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.113161 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.113161 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.113552 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.113630 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.113630 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.113751 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.113877 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.113950 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.114016 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.114016 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.114145 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.114211 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.114289 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.114358 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.114424 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.114488 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.114562 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.114637 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.114876 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.114971 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.115195 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.115312 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.115529 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.117604 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.117604 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.117604 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.117604 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.117938 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.119561 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.119671 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.119761 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.119761 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.119895 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.119963 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.120048 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.120192 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.120275 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.123485 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.123594 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.123669 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.123739 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.124211 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.124211 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.127950 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.128094 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.128184 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.128184 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.128398 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.128480 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.128480 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.128638 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.128718 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.128825 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.128909 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.128909 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.129069 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.129139 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.129139 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.129271 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.129340 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.129340 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.129465 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.129534 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.129600 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.129674 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.129674 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.129842 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.129842 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.129842 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.130027 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.130102 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.130170 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.130170 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.130302 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.130379 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.130466 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.130546 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.130624 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.130701 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.130778 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.130972 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.131085 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.131167 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.131246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.131332 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.131332 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.131476 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.131564 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.131644 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.131723 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.131800 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.131886 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.132048 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.132132 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.136626 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.136801 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.136892 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.136976 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.137080 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.137167 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.137246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.137246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.137394 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.137473 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.137473 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.137622 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.137690 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.137690 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.137690 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.137690 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.138424 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.138497 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.138497 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.138620 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.138695 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.138695 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.138695 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.138919 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.139092 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.139410 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.139834 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.140249 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.140569 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.140938 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.141397 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.141803 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.142271 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.142724 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.143331 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.143331 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.143642 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.143722 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.144066 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.144147 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.144392 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.144470 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.144710 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.144797 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.145024 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.145106 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.145339 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.145547 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.145926 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.146144 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.146225 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.146559 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.146720 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.146887 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.147212 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.147362 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.147533 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.147849 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.147949 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.148454 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.148600 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.148714 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.149187 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.149351 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.149485 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.149814 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.149956 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.150107 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.150434 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.150576 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.150741 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.151045 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.151204 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.151359 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.151648 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.151795 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.152199 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.152293 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.152540 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.152813 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.152893 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.153164 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.153478 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.153577 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.153833 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.154133 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.154244 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.154568 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.154687 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.154873 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.155176 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.155286 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.155489 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.155798 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.155876 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.156100 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.156405 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.156539 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.156707 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.157011 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.157089 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.157311 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.157578 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.157656 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.157929 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.158187 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.158699 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.158699 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.158849 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.159002 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.159336 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.159532 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.159881 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.159964 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.160258 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.160453 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.160564 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.160868 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.161026 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.161208 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.161561 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.161638 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.161954 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.162227 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.162319 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.162631 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.162793 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.162942 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.163788 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.163943 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.164121 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.164418 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.164503 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.164898 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.165022 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.165334 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.165414 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.165646 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.165724 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.165981 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.166061 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.166302 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.166381 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.166612 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.166689 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.166933 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.167020 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.167245 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.167323 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.167554 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.167639 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.167858 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.167950 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.168172 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.168250 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.168550 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.168878 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.168960 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.169090 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.169170 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.169401 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.169478 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.169706 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.169839 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.170051 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.170285 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.170377 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.170479 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.170782 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.170874 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.171085 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.171212 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.171542 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.171633 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.173108 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.173221 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.173296 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.173362 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.173428 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.173501 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.173575 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.173652 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.173728 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.173917 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.173988 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.174054 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.174119 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.174119 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.174256 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.174323 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.174388 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.174608 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.174696 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.174910 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.174988 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.175219 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.175303 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.175525 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.175611 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.175826 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.175910 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.176135 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.176212 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.176437 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.176522 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.176760 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.176839 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.177063 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.177148 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.177364 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.177441 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.177663 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.177746 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.177993 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.178071 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.178296 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.178374 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.178710 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.179570 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.179570 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.179720 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.179821 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.179912 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.180131 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.180221 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.180432 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.180518 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.180737 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.180828 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.181037 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.181207 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.181342 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.181520 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.181641 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.181860 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.181975 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.182183 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.182325 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.182591 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.182760 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.182870 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.182953 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.183166 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.183264 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.183475 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.183576 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.183791 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.183879 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.184103 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.184202 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.184417 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.184504 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.184724 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.184811 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.185062 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.185163 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.185375 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.185463 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.185675 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.185965 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.186055 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.186295 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.186383 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.186600 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.186688 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.186949 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.195790 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.195989 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.196246 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.196343 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.196590 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.196681 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.196924 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.197016 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.197254 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.197343 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.197600 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.197690 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.197954 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.198157 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.198281 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.198554 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.198644 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.198916 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.199051 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.199235 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.199340 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.199555 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.199856 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.199966 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.200162 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.200262 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.200477 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.200567 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.200790 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.200889 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.201104 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.201193 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.201415 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.201503 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.201725 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.201851 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.202069 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.202159 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.202379 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.202467 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.202690 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.202788 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.203001 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.203153 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.203344 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.203514 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.203680 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.203868 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.204021 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.204213 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.204362 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.204552 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.204703 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.204888 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.205057 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.205393 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.205566 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.205656 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.205736 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.206165 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.206285 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.206470 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.206568 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.206860 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.207030 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.207203 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.207498 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.207586 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.207814 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.207909 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.208127 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.208215 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.208438 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.208525 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.208749 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.208853 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.209060 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.209219 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.209386 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.209482 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.209707 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.209984 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.210076 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.210164 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.210387 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.210489 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.210698 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.210786 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.211017 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.211113 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.211332 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.211429 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.211639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.211728 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.212009 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.212105 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.212303 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.212391 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.212620 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.212708 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.212936 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.213022 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.213241 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.213342 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.213560 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.213645 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.213892 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.216897 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.224226 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.224375 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.224375 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.224552 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.224552 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.224702 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.224782 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.224872 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.224964 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.225046 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.225126 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.225194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.225269 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.225346 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.225427 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.225506 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.226111 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.226213 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.226310 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.226392 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.226472 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.226559 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.226640 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.226718 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.226806 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.226887 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.226966 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.227043 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.227123 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.227209 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.227300 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.227388 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.227468 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.227546 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 14:21:41.227633 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.227633 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.227633 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.227633 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.227633 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.227633 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.227633 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.227633 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.228249 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.228249 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.228249 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.228249 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.228249 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.228249 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.228249 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.228249 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.228766 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.228766 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.228766 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.228766 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.228766 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.228766 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.228766 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.228766 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.229311 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.229311 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.229311 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.229311 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.229311 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.229311 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.229311 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.229868 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.229947 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.230215 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.230533 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.230848 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.231160 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.231476 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.231794 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.232129 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.232461 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.232770 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.233097 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.233424 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.233810 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.234119 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.234470 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.234802 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.235120 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.235435 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.235744 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:21:41.235992 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 14:21:41.287350 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO dbcounter [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] Registered counter for database nova_api Jul 14 14:21:41.310847 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO dbcounter [None req-75e48b0b-c3d9-466b-a443-822c173d26f9 None None] Registered counter for database nova_api Jul 14 14:21:41.405355 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_db.sqlalchemy.engines [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:21:41.412453 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writer thread running {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:21:41.433290 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG oslo_db.sqlalchemy.engines [None req-75e48b0b-c3d9-466b-a443-822c173d26f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:21:41.439949 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writer thread running {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:21:41.480871 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.context [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ee12dd37-6f17-45ed-8af9-e0df6fe4a856(cell1) {{(pid=103722) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 14:21:41.484937 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:21:41.486569 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:21:41.487335 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:21:41.489733 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:21:41.492571 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO dbcounter [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] Registered counter for database nova_cell0 Jul 14 14:21:41.496503 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO dbcounter [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] Registered counter for database nova_cell1 Jul 14 14:21:41.498881 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.context [None req-75e48b0b-c3d9-466b-a443-822c173d26f9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ee12dd37-6f17-45ed-8af9-e0df6fe4a856(cell1) {{(pid=103721) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 14:21:41.503280 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-75e48b0b-c3d9-466b-a443-822c173d26f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:21:41.504633 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_db.sqlalchemy.engines [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:21:41.504824 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-75e48b0b-c3d9-466b-a443-822c173d26f9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:21:41.505606 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-75e48b0b-c3d9-466b-a443-822c173d26f9 None None] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:21:41.508289 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_db.sqlalchemy.engines [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:21:41.508552 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-75e48b0b-c3d9-466b-a443-822c173d26f9 None None] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:21:41.510623 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO dbcounter [None req-75e48b0b-c3d9-466b-a443-822c173d26f9 None None] Registered counter for database nova_cell0 Jul 14 14:21:41.514640 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO dbcounter [None req-75e48b0b-c3d9-466b-a443-822c173d26f9 None None] Registered counter for database nova_cell1 Jul 14 14:21:41.515671 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writer thread running {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:21:41.516970 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writer thread running {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:21:41.522049 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG oslo_db.sqlalchemy.engines [None req-75e48b0b-c3d9-466b-a443-822c173d26f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:21:41.523967 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG oslo_db.sqlalchemy.engines [None req-75e48b0b-c3d9-466b-a443-822c173d26f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:21:41.530610 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writer thread running {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:21:41.531901 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writer thread running {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:21:41.683772 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO dbcounter [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] Registered counter for database nova_cell0 Jul 14 14:21:41.692832 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_db.sqlalchemy.engines [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:21:41.698426 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writer thread running {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:21:41.705489 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO dbcounter [None req-75e48b0b-c3d9-466b-a443-822c173d26f9 None None] Registered counter for database nova_cell0 Jul 14 14:21:41.712421 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG oslo_db.sqlalchemy.engines [None req-75e48b0b-c3d9-466b-a443-822c173d26f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:21:41.722167 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writer thread running {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:21:42.181429 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: WARNING keystonemiddleware.auth_token [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:21:42.188715 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: WARNING keystonemiddleware.auth_token [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:21:42.329722 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: WARNING keystonemiddleware.auth_token [None req-75e48b0b-c3d9-466b-a443-822c173d26f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:21:42.340111 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: WARNING keystonemiddleware.auth_token [None req-75e48b0b-c3d9-466b-a443-822c173d26f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:21:42.545697 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: WARNING keystonemiddleware.auth_token [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:21:42.551806 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: WARNING keystonemiddleware.auth_token [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:21:42.557248 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608dd1eb9c0 pid: 103722 (default app) Jul 14 14:21:42.559355 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:21:42.560583 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] 10.222.0.93 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001742 Jul 14 14:21:42.560952 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 1/1] 10.222.0.93 () {50 vars in 788 bytes} [Thu Jul 14 14:21:42 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:21:42.737059 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: WARNING keystonemiddleware.auth_token [None req-75e48b0b-c3d9-466b-a443-822c173d26f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:21:42.743909 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: WARNING keystonemiddleware.auth_token [None req-75e48b0b-c3d9-466b-a443-822c173d26f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:21:42.749426 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608dd1eb9c0 pid: 103721 (default app) Jul 14 14:23:03.425724 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:03.426818 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 14 14:23:03.427372 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 2/2] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 14 14:23:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:23:03.439898 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_api:SELECT=3 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:03.441036 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_cell0:SELECT=3 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:03.441757 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_cell1:SELECT=3 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:03.442781 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:04.313850 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-9dd37e8b-778b-448d-b2eb-6782d6ec0c6c admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:04.344502 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-9dd37e8b-778b-448d-b2eb-6782d6ec0c6c admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.910384 Jul 14 14:23:04.345189 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 1/3] 10.222.0.93 () {60 vars in 1291 bytes} [Thu Jul 14 14:23:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:23:06.653032 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:06.654056 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-9cd3140c-fc09-4338-b154-142c8f33bc04 None None] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Jul 14 14:23:06.654447 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 3/4] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 14 14:23:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:23:07.130880 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-d93e3dae-78ea-4830-9fc8-fc30032b5708 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "c1", "name": "cirros256", "swap": 0, "disk": 1, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:07.152135 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:23:07.152135 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: warnings.warn(msg) Jul 14 14:23:07.269072 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-d93e3dae-78ea-4830-9fc8-fc30032b5708 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.608606 Jul 14 14:23:07.282194 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 2/5] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 14 14:23:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:23:07.284856 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_api:SELECT=3 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:07.286892 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_cell0:SELECT=3 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:07.288001 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_cell1:SELECT=3 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:07.288783 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:07.497151 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-ec985498-be31-4f9d-9af8-203e48fa03b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:07.499594 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:23:07.499594 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: warnings.warn(msg) Jul 14 14:23:07.631737 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-ec985498-be31-4f9d-9af8-203e48fa03b1 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.352792 Jul 14 14:23:07.633104 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 4/6] 10.222.0.93 () {64 vars in 1335 bytes} [Thu Jul 14 14:23:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:23:09.863611 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-d93e3dae-78ea-4830-9fc8-fc30032b5708 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:09.865565 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-d93e3dae-78ea-4830-9fc8-fc30032b5708 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002405 Jul 14 14:23:09.866300 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 3/7] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 14 14:23:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:23:10.524213 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-8382c397-6d4d-4d2e-ae96-5b53a2961c69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 5, "swap": 0, "ram": 512, "id": "d1", "name": "ds512M"}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:10.544185 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:23:10.544185 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: warnings.warn(msg) Jul 14 14:23:10.671961 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-8382c397-6d4d-4d2e-ae96-5b53a2961c69 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.799606 Jul 14 14:23:10.672557 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 5/8] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 14 14:23:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:23:10.686824 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-2ff159f4-d847-4e35-ae02-75e86e633dcb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:10.688428 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:23:10.688428 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: warnings.warn(msg) Jul 14 14:23:10.801003 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-2ff159f4-d847-4e35-ae02-75e86e633dcb admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117963 Jul 14 14:23:10.809817 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 4/9] 10.222.0.93 () {64 vars in 1335 bytes} [Thu Jul 14 14:23:10 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:23:13.090903 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-8382c397-6d4d-4d2e-ae96-5b53a2961c69 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:13.092003 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-8382c397-6d4d-4d2e-ae96-5b53a2961c69 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Jul 14 14:23:13.092467 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 6/10] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 14 14:23:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:23:13.498458 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-d2288278-d217-4201-bfc7-d130e3f8af45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "swap": 0, "ram": 1024}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:13.608115 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-d2288278-d217-4201-bfc7-d130e3f8af45 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.509856 Jul 14 14:23:13.608611 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 5/11] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 14 14:23:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:23:13.621245 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-e958acce-2765-4b28-a8ea-0a7f647003a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:13.754208 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-e958acce-2765-4b28-a8ea-0a7f647003a7 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.136547 Jul 14 14:23:13.754791 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 7/12] 10.222.0.93 () {64 vars in 1335 bytes} [Thu Jul 14 14:23:13 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:23:15.964971 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-d2288278-d217-4201-bfc7-d130e3f8af45 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:15.966083 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-d2288278-d217-4201-bfc7-d130e3f8af45 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 14 14:23:15.966507 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 6/13] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 14 14:23:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:23:16.452053 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-7a58e859-a544-4e5e-9320-1875818b3864 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "name": "ds2G", "swap": 0, "vcpus": 2}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:16.534037 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-7a58e859-a544-4e5e-9320-1875818b3864 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.561511 Jul 14 14:23:16.542333 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 8/14] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 14 14:23:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:23:16.547653 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-27b9b90d-ca90-4488-8582-2241da3200ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:16.650902 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-27b9b90d-ca90-4488-8582-2241da3200ee admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107372 Jul 14 14:23:16.651488 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 7/15] 10.222.0.93 () {64 vars in 1335 bytes} [Thu Jul 14 14:23:16 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:23:18.914346 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-7a58e859-a544-4e5e-9320-1875818b3864 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:18.915353 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-7a58e859-a544-4e5e-9320-1875818b3864 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jul 14 14:23:18.916027 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 9/16] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 14 14:23:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:23:19.386418 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-e9da68fd-b1d6-444c-b111-c7e7be855f68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G", "id": "d4", "disk": 20, "ram": 4096}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:19.477003 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-e9da68fd-b1d6-444c-b111-c7e7be855f68 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.555188 Jul 14 14:23:19.484430 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 8/17] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 14 14:23:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:23:19.489844 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-53506c5b-136d-49b2-88b1-00b89f608f1b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:19.605073 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-53506c5b-136d-49b2-88b1-00b89f608f1b admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119053 Jul 14 14:23:19.605577 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 10/18] 10.222.0.93 () {64 vars in 1335 bytes} [Thu Jul 14 14:23:19 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:23:22.188488 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-e9da68fd-b1d6-444c-b111-c7e7be855f68 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:22.189624 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-e9da68fd-b1d6-444c-b111-c7e7be855f68 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jul 14 14:23:22.190183 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 9/19] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 14 14:23:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:23:22.620008 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-fd05fcea-e159-43ee-911f-2f12f1f4a2ba admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:22.644951 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-fd05fcea-e159-43ee-911f-2f12f1f4a2ba admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.447857 Jul 14 14:23:22.645519 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 11/20] 10.222.0.93 () {60 vars in 1291 bytes} [Thu Jul 14 14:23:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:23:24.964101 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-e9da68fd-b1d6-444c-b111-c7e7be855f68 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:24.965110 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-e9da68fd-b1d6-444c-b111-c7e7be855f68 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 14 14:23:24.965715 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 10/21] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 14 14:23:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:23:25.430825 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-926672f5-0032-4285-8d62-89a29aadf1cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "ram": 512}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:25.507495 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-926672f5-0032-4285-8d62-89a29aadf1cf admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.535755 Jul 14 14:23:25.508349 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 12/22] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 14 14:23:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:23:25.522132 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-3840b04f-b873-4bd4-83d8-b218d7fc24b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:25.599706 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-3840b04f-b873-4bd4-83d8-b218d7fc24b8 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082190 Jul 14 14:23:25.600170 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 11/23] 10.222.0.93 () {64 vars in 1332 bytes} [Thu Jul 14 14:23:25 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:23:27.817576 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-926672f5-0032-4285-8d62-89a29aadf1cf admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:27.818547 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-926672f5-0032-4285-8d62-89a29aadf1cf admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 14 14:23:27.818949 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 13/24] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 14 14:23:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:23:28.229101 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-34480e15-dfcd-4184-9df9-d960dfaf232a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "2", "os-flavor-access:is_public": true}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:28.304319 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-34480e15-dfcd-4184-9df9-d960dfaf232a admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.479775 Jul 14 14:23:28.304976 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 12/25] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 14 14:23:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:23:28.316969 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-05cdda39-dfb7-431a-9921-b84da7a6d56f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:28.445555 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-05cdda39-dfb7-431a-9921-b84da7a6d56f admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132714 Jul 14 14:23:28.448790 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 14/26] 10.222.0.93 () {64 vars in 1332 bytes} [Thu Jul 14 14:23:28 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:23:30.717713 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-34480e15-dfcd-4184-9df9-d960dfaf232a admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:30.718683 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-34480e15-dfcd-4184-9df9-d960dfaf232a admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Jul 14 14:23:30.719083 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 13/27] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 14 14:23:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:23:31.088519 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-e4c327e9-c085-47a8-b421-ff1f35acd70a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "id": "3", "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:31.203350 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-e4c327e9-c085-47a8-b421-ff1f35acd70a admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.477692 Jul 14 14:23:31.204197 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 15/28] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 14 14:23:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:23:31.216074 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-d5039ac7-c59f-437c-9244-2169e3cb491a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:31.320558 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-d5039ac7-c59f-437c-9244-2169e3cb491a admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108050 Jul 14 14:23:31.321163 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 14/29] 10.222.0.93 () {64 vars in 1332 bytes} [Thu Jul 14 14:23:31 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:23:33.596457 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-e4c327e9-c085-47a8-b421-ff1f35acd70a admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:33.597481 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-e4c327e9-c085-47a8-b421-ff1f35acd70a admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 14 14:23:33.598198 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 16/30] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 14 14:23:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:23:34.060100 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-c0fb732c-785f-49fe-b205-fdfd77963866 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 80, "vcpus": 4, "ram": 8192, "os-flavor-access:is_public": true}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:34.068837 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:23:34.160991 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-c0fb732c-785f-49fe-b205-fdfd77963866 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.557059 Jul 14 14:23:34.161867 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 15/31] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 14 14:23:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:23:34.174561 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-41cef6de-0296-4aa2-a516-eedf2381f2d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:34.332810 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-41cef6de-0296-4aa2-a516-eedf2381f2d4 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.162072 Jul 14 14:23:34.333450 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 17/32] 10.222.0.93 () {64 vars in 1332 bytes} [Thu Jul 14 14:23:34 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:23:36.620229 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-c0fb732c-785f-49fe-b205-fdfd77963866 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:36.622040 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-c0fb732c-785f-49fe-b205-fdfd77963866 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002132 Jul 14 14:23:36.622377 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 16/33] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 14 14:23:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:23:37.090336 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-1979157e-2bce-4c61-a3e6-130f4aafe742 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "rxtx_factor": 1.0, "vcpus": 8, "name": "m1.xlarge", "id": "5", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:37.178382 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-1979157e-2bce-4c61-a3e6-130f4aafe742 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.550135 Jul 14 14:23:37.179140 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 18/34] 10.222.0.93 () {64 vars in 1282 bytes} [Thu Jul 14 14:23:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:23:37.193804 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-dae5a42a-0141-40cb-9f85-66c2e8544fc8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:23:37.348563 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-dae5a42a-0141-40cb-9f85-66c2e8544fc8 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.161390 Jul 14 14:23:37.349381 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 17/35] 10.222.0.93 () {64 vars in 1332 bytes} [Thu Jul 14 14:23:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:23:58.133876 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-1979157e-2bce-4c61-a3e6-130f4aafe742 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:58.134877 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-1979157e-2bce-4c61-a3e6-130f4aafe742 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jul 14 14:23:58.135276 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 19/36] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 14 14:23:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:23:58.529699 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-1b83386a-68c9-4846-8ed8-98b319bac01d admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:58.547123 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-1b83386a-68c9-4846-8ed8-98b319bac01d admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405871 Jul 14 14:23:58.547589 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 18/37] 10.222.0.93 () {60 vars in 1291 bytes} [Thu Jul 14 14:23:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:23:59.616330 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-1979157e-2bce-4c61-a3e6-130f4aafe742 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:59.617363 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-1979157e-2bce-4c61-a3e6-130f4aafe742 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 14 14:23:59.617758 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 20/38] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 14 14:23:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:24:00.270373 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-34bf5a65-ce2c-4cdf-956e-99d7bd1fd00d admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:00.276034 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.wsgi [None req-34bf5a65-ce2c-4cdf-956e-99d7bd1fd00d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-34bf5a65-ce2c-4cdf-956e-99d7bd1fd00d admin admin] Request method failure captured: Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Accept: application/json Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Accept-Encoding: gzip, deflate Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Connection: keep-alive Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Content-Length: 0 Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Host: 10.222.0.93 Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Openstack-Api-Version: compute 2.90 Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Openstack-System-Scope: None Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: User-Agent: python-novaclient Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Auth-Token: gAAAAABi0Cb_p-lkEWgELroul4c7XfiU2dm2P0CtguR0nTe3f2xdnD-k0SFlfrWydhMlZRlxBUT8upKp2BxB-IxMb_kukRTsYupca0T8Hu1vczkyJDTMNhJm93O8l59wbjI3X-RIUKzBT61-QJ0eNF8gKTrsNcoRawjNXHiGFBd5pMRdO6fOUQg Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Domain-Id: None Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Domain-Name: None Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Identity-Status: Confirmed Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Is-Admin-Project: True Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Project-Domain-Id: default Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Project-Domain-Name: Default Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Project-Id: df24a39f5f0a46c8b40d27ec05417d32 Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Project-Name: admin Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Role: admin,member,reader Jul 14 14:24:00.280979 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Roles: admin,member,reader Jul 14 14:24:00.282793 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:24:00.282793 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Tenant: admin Jul 14 14:24:00.282793 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Tenant-Id: df24a39f5f0a46c8b40d27ec05417d32 Jul 14 14:24:00.282793 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Tenant-Name: admin Jul 14 14:24:00.282793 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-User: admin Jul 14 14:24:00.282793 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-User-Domain-Id: default Jul 14 14:24:00.282793 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-User-Domain-Name: Default Jul 14 14:24:00.282793 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-User-Id: 2be999d55fd24e54ae049877c17b8c43 Jul 14 14:24:00.282793 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-User-Name: admin Jul 14 14:24:00.282793 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: method: > Jul 14 14:24:00.282793 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: exception: Flavor 42 could not be found. Jul 14 14:24:00.282793 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: action_args: {'id': '42'} Jul 14 14:24:00.282793 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:24:00.282793 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:24:00.284449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 14:24:00.284449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 14:24:00.284449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:24:00.284449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:24:00.284449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:24:00.284449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:24:00.284449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:24:00.284449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:24:00.284449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:24:00.284449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:24:00.284449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:24:00.284449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:24:00.284449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 14:24:00.284449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 14:24:00.284449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:24:00.284449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 14:24:00.284449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:24:00.284449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:24:00.284449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:24:00.285885 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:24:00.285885 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:24:00.285885 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:24:00.285885 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:24:00.285885 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 14:24:00.285885 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:24:00.285885 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 14:24:00.285885 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 14:24:00.285885 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:24:00.285885 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 14:24:00.285885 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:24:00.285885 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:24:00.285885 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:24:00.285885 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:24:00.285885 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:24:00.285885 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 14:24:00.285885 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 14:24:00.285885 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-34bf5a65-ce2c-4cdf-956e-99d7bd1fd00d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:24:00.287178 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-34bf5a65-ce2c-4cdf-956e-99d7bd1fd00d admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.527050 Jul 14 14:24:00.287178 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 19/39] 10.222.0.93 () {60 vars in 1190 bytes} [Thu Jul 14 14:23:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 528 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:24:00.292967 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-ec34d8f6-6695-4a55-8e80-b2ec20802899 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:00.296112 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:24:00.315696 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-ec34d8f6-6695-4a55-8e80-b2ec20802899 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026222 Jul 14 14:24:00.316466 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 21/40] 10.222.0.93 () {60 vars in 1210 bytes} [Thu Jul 14 14:24:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:24:00.326286 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-0273c753-fdad-4abb-800a-df289560d771 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:00.349131 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-0273c753-fdad-4abb-800a-df289560d771 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026334 Jul 14 14:24:00.349735 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 20/41] 10.222.0.93 () {60 vars in 1210 bytes} [Thu Jul 14 14:24:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:24:00.359456 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-e86316ac-ec80-435d-a612-ff4b0b8ec796 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:00.366386 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.wsgi [None req-e86316ac-ec80-435d-a612-ff4b0b8ec796 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-e86316ac-ec80-435d-a612-ff4b0b8ec796 admin admin] Request method failure captured: Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Accept: application/json Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Accept-Encoding: gzip, deflate Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Connection: keep-alive Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Content-Length: 0 Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Host: 10.222.0.93 Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Openstack-Api-Version: compute 2.90 Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Openstack-System-Scope: None Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: User-Agent: python-novaclient Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Auth-Token: gAAAAABi0Cb_p-lkEWgELroul4c7XfiU2dm2P0CtguR0nTe3f2xdnD-k0SFlfrWydhMlZRlxBUT8upKp2BxB-IxMb_kukRTsYupca0T8Hu1vczkyJDTMNhJm93O8l59wbjI3X-RIUKzBT61-QJ0eNF8gKTrsNcoRawjNXHiGFBd5pMRdO6fOUQg Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Domain-Id: None Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Domain-Name: None Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Identity-Status: Confirmed Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Is-Admin-Project: True Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Project-Domain-Id: default Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Project-Domain-Name: Default Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Project-Id: df24a39f5f0a46c8b40d27ec05417d32 Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Project-Name: admin Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Role: admin,member,reader Jul 14 14:24:00.369639 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Roles: admin,member,reader Jul 14 14:24:00.371016 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:24:00.371016 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Tenant: admin Jul 14 14:24:00.371016 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Tenant-Id: df24a39f5f0a46c8b40d27ec05417d32 Jul 14 14:24:00.371016 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Tenant-Name: admin Jul 14 14:24:00.371016 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-User: admin Jul 14 14:24:00.371016 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-User-Domain-Id: default Jul 14 14:24:00.371016 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-User-Domain-Name: Default Jul 14 14:24:00.371016 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-User-Id: 2be999d55fd24e54ae049877c17b8c43 Jul 14 14:24:00.371016 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-User-Name: admin Jul 14 14:24:00.371016 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: method: > Jul 14 14:24:00.371016 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: exception: Flavor 42 could not be found. Jul 14 14:24:00.371016 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: action_args: {'id': '42'} Jul 14 14:24:00.371016 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:24:00.371016 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:24:00.371857 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 14:24:00.371857 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 14:24:00.371857 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:24:00.371857 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:24:00.371857 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:24:00.371857 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:24:00.371857 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:24:00.371857 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:24:00.371857 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:24:00.371857 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:24:00.371857 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:24:00.371857 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:24:00.371857 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 14:24:00.371857 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 14:24:00.371857 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:24:00.371857 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 14:24:00.371857 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:24:00.371857 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:24:00.371857 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:24:00.372999 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:24:00.372999 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:24:00.372999 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:24:00.372999 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:24:00.372999 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 14:24:00.372999 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:24:00.372999 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 14:24:00.372999 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 14:24:00.372999 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:24:00.372999 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 14:24:00.372999 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:24:00.372999 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:24:00.372999 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:24:00.372999 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:24:00.372999 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:24:00.372999 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 14:24:00.372999 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 14:24:00.372999 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-e86316ac-ec80-435d-a612-ff4b0b8ec796 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:24:00.375123 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-e86316ac-ec80-435d-a612-ff4b0b8ec796 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015595 Jul 14 14:24:00.375123 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 22/42] 10.222.0.93 () {60 vars in 1190 bytes} [Thu Jul 14 14:24:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:24:01.343864 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-0273c753-fdad-4abb-800a-df289560d771 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:01.344882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-0273c753-fdad-4abb-800a-df289560d771 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 14 14:24:01.345278 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 21/43] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 14 14:24:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:24:01.866775 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-31a59bbd-b727-467f-8f6e-b87e81dacb9e admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:01.872107 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.wsgi [None req-31a59bbd-b727-467f-8f6e-b87e81dacb9e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-31a59bbd-b727-467f-8f6e-b87e81dacb9e admin admin] Request method failure captured: Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Accept: application/json Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Accept-Encoding: gzip, deflate Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Connection: keep-alive Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Content-Length: 0 Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Host: 10.222.0.93 Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Openstack-Api-Version: compute 2.90 Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Openstack-System-Scope: None Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: User-Agent: python-novaclient Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Auth-Token: gAAAAABi0CcBhC3rqJx0VtJzld4qXZxng8t3NM-UtZLj5Y-_mpkqFLicsPTjnPK82cuj6OuVLseQVLjfkdPnXLY709TUzOjl6GTuwZXDKhW622mAD5ZCznfupnVEO9Kh2wTc4SsbSwtCff9pjiMotij8uGa6tc--9V_NqXRFqSQTOf_eBDx2vAI Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Domain-Id: None Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Domain-Name: None Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Identity-Status: Confirmed Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Is-Admin-Project: True Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Project-Domain-Id: default Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Project-Domain-Name: Default Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Project-Id: df24a39f5f0a46c8b40d27ec05417d32 Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Project-Name: admin Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Role: admin,member,reader Jul 14 14:24:01.873660 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Roles: admin,member,reader Jul 14 14:24:01.875239 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:24:01.875239 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Tenant: admin Jul 14 14:24:01.875239 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Tenant-Id: df24a39f5f0a46c8b40d27ec05417d32 Jul 14 14:24:01.875239 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Tenant-Name: admin Jul 14 14:24:01.875239 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-User: admin Jul 14 14:24:01.875239 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-User-Domain-Id: default Jul 14 14:24:01.875239 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-User-Domain-Name: Default Jul 14 14:24:01.875239 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-User-Id: 2be999d55fd24e54ae049877c17b8c43 Jul 14 14:24:01.875239 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-User-Name: admin Jul 14 14:24:01.875239 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: method: > Jul 14 14:24:01.875239 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: exception: Flavor 84 could not be found. Jul 14 14:24:01.875239 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: action_args: {'id': '84'} Jul 14 14:24:01.875239 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:24:01.875239 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:24:01.876131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 14:24:01.876131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 14:24:01.876131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:24:01.876131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:24:01.876131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:24:01.876131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:24:01.876131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:24:01.876131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:24:01.876131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:24:01.876131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:24:01.876131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:24:01.876131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:24:01.876131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 14:24:01.876131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 14:24:01.876131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:24:01.876131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 14:24:01.876131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:24:01.876131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:24:01.876131 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:24:01.877227 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:24:01.877227 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:24:01.877227 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:24:01.877227 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:24:01.877227 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 14:24:01.877227 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:24:01.877227 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 14:24:01.877227 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 14:24:01.877227 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:24:01.877227 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 14:24:01.877227 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:24:01.877227 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:24:01.877227 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:24:01.877227 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:24:01.877227 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:24:01.877227 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 14:24:01.877227 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 14:24:01.877227 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-31a59bbd-b727-467f-8f6e-b87e81dacb9e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:24:01.878504 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-31a59bbd-b727-467f-8f6e-b87e81dacb9e admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.392011 Jul 14 14:24:01.878504 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 23/44] 10.222.0.93 () {60 vars in 1190 bytes} [Thu Jul 14 14:24:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:24:01.884511 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-e5ee86cb-9fee-4147-ae90-547431786ab7 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:01.898725 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-e5ee86cb-9fee-4147-ae90-547431786ab7 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017654 Jul 14 14:24:01.899193 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 22/45] 10.222.0.93 () {60 vars in 1210 bytes} [Thu Jul 14 14:24:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:24:01.908454 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-551fb936-d0a1-4009-96e3-6bf342c32bad admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:01.922633 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-551fb936-d0a1-4009-96e3-6bf342c32bad admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017640 Jul 14 14:24:01.923154 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 24/46] 10.222.0.93 () {60 vars in 1210 bytes} [Thu Jul 14 14:24:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:24:01.932828 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-484aaa95-bbab-4f63-a05e-25ec127a2e44 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:01.938244 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.wsgi [None req-484aaa95-bbab-4f63-a05e-25ec127a2e44 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-484aaa95-bbab-4f63-a05e-25ec127a2e44 admin admin] Request method failure captured: Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Accept: application/json Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Accept-Encoding: gzip, deflate Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Connection: keep-alive Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Content-Length: 0 Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Host: 10.222.0.93 Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Openstack-Api-Version: compute 2.90 Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Openstack-System-Scope: None Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: User-Agent: python-novaclient Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Auth-Token: gAAAAABi0CcBhC3rqJx0VtJzld4qXZxng8t3NM-UtZLj5Y-_mpkqFLicsPTjnPK82cuj6OuVLseQVLjfkdPnXLY709TUzOjl6GTuwZXDKhW622mAD5ZCznfupnVEO9Kh2wTc4SsbSwtCff9pjiMotij8uGa6tc--9V_NqXRFqSQTOf_eBDx2vAI Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Domain-Id: None Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Domain-Name: None Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Identity-Status: Confirmed Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Is-Admin-Project: True Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Project-Domain-Id: default Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Project-Domain-Name: Default Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Project-Id: df24a39f5f0a46c8b40d27ec05417d32 Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Project-Name: admin Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Role: admin,member,reader Jul 14 14:24:01.939882 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Roles: admin,member,reader Jul 14 14:24:01.941479 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:24:01.941479 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Tenant: admin Jul 14 14:24:01.941479 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Tenant-Id: df24a39f5f0a46c8b40d27ec05417d32 Jul 14 14:24:01.941479 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Tenant-Name: admin Jul 14 14:24:01.941479 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-User: admin Jul 14 14:24:01.941479 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-User-Domain-Id: default Jul 14 14:24:01.941479 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-User-Domain-Name: Default Jul 14 14:24:01.941479 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-User-Id: 2be999d55fd24e54ae049877c17b8c43 Jul 14 14:24:01.941479 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-User-Name: admin Jul 14 14:24:01.941479 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: method: > Jul 14 14:24:01.941479 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: exception: Flavor 84 could not be found. Jul 14 14:24:01.941479 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: action_args: {'id': '84'} Jul 14 14:24:01.941479 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:24:01.941479 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:24:01.942483 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 14:24:01.942483 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 14:24:01.942483 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:24:01.942483 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:24:01.942483 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:24:01.942483 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:24:01.942483 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:24:01.942483 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:24:01.942483 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:24:01.942483 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:24:01.942483 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:24:01.942483 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:24:01.942483 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 14:24:01.942483 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 14:24:01.942483 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:24:01.942483 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 14:24:01.942483 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:24:01.942483 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:24:01.942483 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:24:01.943782 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:24:01.943782 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:24:01.943782 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:24:01.943782 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:24:01.943782 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 14:24:01.943782 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:24:01.943782 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 14:24:01.943782 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 14:24:01.943782 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:24:01.943782 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 14:24:01.943782 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:24:01.943782 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:24:01.943782 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:24:01.943782 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:24:01.943782 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:24:01.943782 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 14:24:01.943782 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 14:24:01.943782 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-484aaa95-bbab-4f63-a05e-25ec127a2e44 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:24:01.944988 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-484aaa95-bbab-4f63-a05e-25ec127a2e44 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012025 Jul 14 14:24:01.944988 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 23/47] 10.222.0.93 () {60 vars in 1190 bytes} [Thu Jul 14 14:24:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:24:02.917726 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-551fb936-d0a1-4009-96e3-6bf342c32bad admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:02.918743 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-551fb936-d0a1-4009-96e3-6bf342c32bad admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 14 14:24:02.919132 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 25/48] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 14 14:24:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:24:03.437252 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-5c1370de-33da-4903-805e-b3ab105720db admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:03.443649 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.wsgi [None req-5c1370de-33da-4903-805e-b3ab105720db admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-5c1370de-33da-4903-805e-b3ab105720db admin admin] Request method failure captured: Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Accept: application/json Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Accept-Encoding: gzip, deflate Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Connection: keep-alive Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Content-Length: 0 Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Host: 10.222.0.93 Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Openstack-Api-Version: compute 2.90 Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Openstack-System-Scope: None Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: User-Agent: python-novaclient Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Auth-Token: gAAAAABi0CcCVUJqniKKZwygsc9b0fhLN1EXrt1jIaIUYZhICbylTJPX0RC01M5rIOtFF6Ym-cwqu6376PXRECCMfWq1zUC9tA4jksA5He3UtylbyFTpqLu698rcvu0j1Skerc0i-EbymUVMkBFfVQnmAEYazwcItKk5MS-C411GKhuITxcAbW4 Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Domain-Id: None Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Domain-Name: None Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Identity-Status: Confirmed Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Is-Admin-Project: True Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Project-Domain-Id: default Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Project-Domain-Name: Default Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Project-Id: df24a39f5f0a46c8b40d27ec05417d32 Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Project-Name: admin Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Role: admin,member,reader Jul 14 14:24:03.445122 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Roles: admin,member,reader Jul 14 14:24:03.446774 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:24:03.446774 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Tenant: admin Jul 14 14:24:03.446774 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Tenant-Id: df24a39f5f0a46c8b40d27ec05417d32 Jul 14 14:24:03.446774 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-Tenant-Name: admin Jul 14 14:24:03.446774 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-User: admin Jul 14 14:24:03.446774 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-User-Domain-Id: default Jul 14 14:24:03.446774 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-User-Domain-Name: Default Jul 14 14:24:03.446774 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-User-Id: 2be999d55fd24e54ae049877c17b8c43 Jul 14 14:24:03.446774 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: X-User-Name: admin Jul 14 14:24:03.446774 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: method: > Jul 14 14:24:03.446774 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: exception: Flavor 451 could not be found. Jul 14 14:24:03.446774 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: action_args: {'id': '451'} Jul 14 14:24:03.446774 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:24:03.446774 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:24:03.447726 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 14:24:03.447726 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 14:24:03.447726 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:24:03.447726 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:24:03.447726 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:24:03.447726 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:24:03.447726 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:24:03.447726 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:24:03.447726 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:24:03.447726 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:24:03.447726 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:24:03.447726 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:24:03.447726 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 14:24:03.447726 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 14:24:03.447726 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:24:03.447726 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 14:24:03.447726 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:24:03.447726 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:24:03.447726 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:24:03.449058 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:24:03.449058 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:24:03.449058 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:24:03.449058 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:24:03.449058 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 14:24:03.449058 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:24:03.449058 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 14:24:03.449058 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 14:24:03.449058 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:24:03.449058 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 14:24:03.449058 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:24:03.449058 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:24:03.449058 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:24:03.449058 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:24:03.449058 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:24:03.449058 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 14:24:03.449058 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 14:24:03.449058 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-5c1370de-33da-4903-805e-b3ab105720db admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:24:03.450386 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-5c1370de-33da-4903-805e-b3ab105720db admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.389520 Jul 14 14:24:03.450386 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 24/49] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Jul 14 14:24:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:24:03.456287 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-654b4154-c136-4a2c-8ca5-6d780a5abe01 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:03.470419 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-654b4154-c136-4a2c-8ca5-6d780a5abe01 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017732 Jul 14 14:24:03.470969 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 26/50] 10.222.0.93 () {60 vars in 1210 bytes} [Thu Jul 14 14:24:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:24:03.480345 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-a74e875a-bcab-435d-90c1-8a09c5c1b432 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:03.495999 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-a74e875a-bcab-435d-90c1-8a09c5c1b432 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019173 Jul 14 14:24:03.496531 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 25/51] 10.222.0.93 () {60 vars in 1210 bytes} [Thu Jul 14 14:24:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:24:03.506210 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-4d4b7314-13fb-4176-bf12-5a583c4df146 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:03.511712 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.wsgi [None req-4d4b7314-13fb-4176-bf12-5a583c4df146 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-4d4b7314-13fb-4176-bf12-5a583c4df146 admin admin] Request method failure captured: Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Accept: application/json Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Accept-Encoding: gzip, deflate Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Connection: keep-alive Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Content-Length: 0 Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Host: 10.222.0.93 Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Openstack-Api-Version: compute 2.90 Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Openstack-System-Scope: None Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: User-Agent: python-novaclient Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Auth-Token: gAAAAABi0CcCVUJqniKKZwygsc9b0fhLN1EXrt1jIaIUYZhICbylTJPX0RC01M5rIOtFF6Ym-cwqu6376PXRECCMfWq1zUC9tA4jksA5He3UtylbyFTpqLu698rcvu0j1Skerc0i-EbymUVMkBFfVQnmAEYazwcItKk5MS-C411GKhuITxcAbW4 Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Domain-Id: None Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Domain-Name: None Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Identity-Status: Confirmed Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Is-Admin-Project: True Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Project-Domain-Id: default Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Project-Domain-Name: Default Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Project-Id: df24a39f5f0a46c8b40d27ec05417d32 Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Project-Name: admin Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Role: admin,member,reader Jul 14 14:24:03.513194 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Roles: admin,member,reader Jul 14 14:24:03.514786 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/df24a39f5f0a46c8b40d27ec05417d32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:24:03.514786 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Tenant: admin Jul 14 14:24:03.514786 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Tenant-Id: df24a39f5f0a46c8b40d27ec05417d32 Jul 14 14:24:03.514786 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-Tenant-Name: admin Jul 14 14:24:03.514786 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-User: admin Jul 14 14:24:03.514786 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-User-Domain-Id: default Jul 14 14:24:03.514786 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-User-Domain-Name: Default Jul 14 14:24:03.514786 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-User-Id: 2be999d55fd24e54ae049877c17b8c43 Jul 14 14:24:03.514786 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: X-User-Name: admin Jul 14 14:24:03.514786 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: method: > Jul 14 14:24:03.514786 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: exception: Flavor 451 could not be found. Jul 14 14:24:03.514786 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: action_args: {'id': '451'} Jul 14 14:24:03.514786 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:24:03.514786 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:24:03.515908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 14:24:03.515908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 14:24:03.515908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:24:03.515908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:24:03.515908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:24:03.515908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:24:03.515908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:24:03.515908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:24:03.515908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:24:03.515908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:24:03.515908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:24:03.515908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:24:03.515908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 14:24:03.515908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 14:24:03.515908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:24:03.515908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 14:24:03.515908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:24:03.515908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:24:03.515908 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:24:03.517246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:24:03.517246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:24:03.517246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:24:03.517246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:24:03.517246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 14:24:03.517246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:24:03.517246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 14:24:03.517246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 14:24:03.517246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:24:03.517246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 14:24:03.517246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:24:03.517246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:24:03.517246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:24:03.517246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:24:03.517246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:24:03.517246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 14:24:03.517246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: ERROR nova.api.openstack.wsgi Jul 14 14:24:03.517246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-4d4b7314-13fb-4176-bf12-5a583c4df146 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:24:03.518538 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-4d4b7314-13fb-4176-bf12-5a583c4df146 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012432 Jul 14 14:24:03.518538 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 27/52] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Jul 14 14:24:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:24:04.489276 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-a74e875a-bcab-435d-90c1-8a09c5c1b432 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:04.491691 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-a74e875a-bcab-435d-90c1-8a09c5c1b432 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002835 Jul 14 14:24:04.492085 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 26/53] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 14 14:24:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:24:05.052698 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-19e38f3b-7c6f-4c75-8a3a-fb41b209e4e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:24:05.137668 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-19e38f3b-7c6f-4c75-8a3a-fb41b209e4e8 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.494187 Jul 14 14:24:05.138246 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 28/54] 10.222.0.93 () {64 vars in 1235 bytes} [Thu Jul 14 14:24:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:24:06.126823 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-a74e875a-bcab-435d-90c1-8a09c5c1b432 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:06.127829 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-a74e875a-bcab-435d-90c1-8a09c5c1b432 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 14 14:24:06.128219 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 27/55] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 14 14:24:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:24:06.666803 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-288f8a5b-4dc2-4803-b8e5-5e2b19936c09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:24:06.725592 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-288f8a5b-4dc2-4803-b8e5-5e2b19936c09 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.459718 Jul 14 14:24:06.726178 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 29/56] 10.222.0.93 () {64 vars in 1235 bytes} [Thu Jul 14 14:24:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:24:07.711962 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-a74e875a-bcab-435d-90c1-8a09c5c1b432 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:07.712991 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-a74e875a-bcab-435d-90c1-8a09c5c1b432 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Jul 14 14:24:07.713380 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 28/57] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 14 14:24:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:24:08.241661 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-8ec11643-54a9-4492-a39e-7b24cdf21026 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:24:08.331407 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-8ec11643-54a9-4492-a39e-7b24cdf21026 admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.479037 Jul 14 14:24:08.331948 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 30/58] 10.222.0.93 () {64 vars in 1235 bytes} [Thu Jul 14 14:24:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:24:09.309449 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-a74e875a-bcab-435d-90c1-8a09c5c1b432 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:09.310475 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-a74e875a-bcab-435d-90c1-8a09c5c1b432 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jul 14 14:24:09.310865 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 29/59] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 14 14:24:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:24:09.831461 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-a33ea555-f487-4c21-94db-76089d03728e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:24:09.904189 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-a33ea555-f487-4c21-94db-76089d03728e admin admin] 10.222.0.93 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.455124 Jul 14 14:24:09.904726 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 31/60] 10.222.0.93 () {64 vars in 1235 bytes} [Thu Jul 14 14:24:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:24:10.889472 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-a74e875a-bcab-435d-90c1-8a09c5c1b432 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:10.890498 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-a74e875a-bcab-435d-90c1-8a09c5c1b432 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 14 14:24:10.890886 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 30/61] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 14 14:24:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:24:11.432422 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-d9022a12-9522-4537-850c-a7f8eb1afdee admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:24:11.451440 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-d9022a12-9522-4537-850c-a7f8eb1afdee admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.421354 Jul 14 14:24:11.451961 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 32/62] 10.222.0.93 () {60 vars in 1202 bytes} [Thu Jul 14 14:24:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:25:04.520251 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-a74e875a-bcab-435d-90c1-8a09c5c1b432 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:04.521257 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-a74e875a-bcab-435d-90c1-8a09c5c1b432 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 14 14:25:04.521651 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 31/63] 10.222.0.93 () {54 vars in 930 bytes} [Thu Jul 14 14:25:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:04.532181 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:04.923342 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-2d0010fa-720b-48b0-937d-6db130a649cb admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:04.943265 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-2d0010fa-720b-48b0-937d-6db130a649cb admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.415503 Jul 14 14:25:04.943745 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 33/64] 10.222.0.93 () {60 vars in 1291 bytes} [Thu Jul 14 14:25:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:25:04.964439 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:04.968644 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-edf2e1de-94bb-4865-9435-5a32607fc57a admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:04.976267 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-edf2e1de-94bb-4865-9435-5a32607fc57a admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013282 Jul 14 14:25:04.978107 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 32/65] 10.222.0.93 () {60 vars in 1282 bytes} [Thu Jul 14 14:25:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:04.989133 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-e95b93e9-4ac3-4c77-b9dd-b34bd7aa8840 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:04.996867 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-e95b93e9-4ac3-4c77-b9dd-b34bd7aa8840 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012099 Jul 14 14:25:04.997385 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 34/66] 10.222.0.93 () {60 vars in 1285 bytes} [Thu Jul 14 14:25:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:05.009496 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-f1539f64-00a5-43f1-bfe8-bef4fc195748 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:05.017420 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-f1539f64-00a5-43f1-bfe8-bef4fc195748 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011491 Jul 14 14:25:05.017968 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 33/67] 10.222.0.93 () {60 vars in 1285 bytes} [Thu Jul 14 14:25:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:05.029177 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-bc034825-d097-46f8-8094-d733da0d2ad0 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:05.036878 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-bc034825-d097-46f8-8094-d733da0d2ad0 admin admin] 10.222.0.93 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011309 Jul 14 14:25:05.037401 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 35/68] 10.222.0.93 () {60 vars in 1282 bytes} [Thu Jul 14 14:25:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:28:38.141435 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-f1539f64-00a5-43f1-bfe8-bef4fc195748 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:38.142469 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-f1539f64-00a5-43f1-bfe8-bef4fc195748 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 14 14:28:38.142862 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 34/69] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 14 14:28:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:38.298979 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_api:SELECT=6 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:38.470550 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-e79103b9-383a-43b3-aeaf-e2a37379e321 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:38.472090 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:28:38.472090 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: warnings.warn(msg) Jul 14 14:28:38.473307 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-e79103b9-383a-43b3-aeaf-e2a37379e321 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:38.473914 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-e79103b9-383a-43b3-aeaf-e2a37379e321 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:38.474710 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-e79103b9-383a-43b3-aeaf-e2a37379e321 admin admin] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:38.475141 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-e79103b9-383a-43b3-aeaf-e2a37379e321 admin admin] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:38.510677 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-e79103b9-383a-43b3-aeaf-e2a37379e321 admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.213543 Jul 14 14:28:38.511243 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 36/70] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Jul 14 14:28:38 2022] GET /compute/v2.1/os-services => generated 794 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:28:39.374786 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-f1539f64-00a5-43f1-bfe8-bef4fc195748 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:39.375801 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-f1539f64-00a5-43f1-bfe8-bef4fc195748 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001857 Jul 14 14:28:39.376204 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 35/71] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 14 14:28:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:39.587258 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-7cab1fc5-e651-4626-82b0-ea1b74ed0dbd admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:39.588429 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:28:39.588429 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: warnings.warn(msg) Jul 14 14:28:39.589600 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-7cab1fc5-e651-4626-82b0-ea1b74ed0dbd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:39.590081 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-7cab1fc5-e651-4626-82b0-ea1b74ed0dbd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:39.590883 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-7cab1fc5-e651-4626-82b0-ea1b74ed0dbd admin admin] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:39.591306 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-7cab1fc5-e651-4626-82b0-ea1b74ed0dbd admin admin] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:39.614898 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-7cab1fc5-e651-4626-82b0-ea1b74ed0dbd admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.095369 Jul 14 14:28:39.615479 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 37/72] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Jul 14 14:28:39 2022] GET /compute/v2.1/os-services => generated 794 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:28:50.840054 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-f1539f64-00a5-43f1-bfe8-bef4fc195748 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:50.841055 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-f1539f64-00a5-43f1-bfe8-bef4fc195748 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jul 14 14:28:50.842029 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 36/73] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 14 14:28:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:28:50.986477 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_cell0:SELECT=4 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:50.987218 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_cell1:SELECT=4 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:50.987846 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG dbcounter [-] [103722] Writing DB stats nova_api:SELECT=8 {{(pid=103722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:28:51.036688 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-1ab9d4c6-f085-4d3f-800e-606669869506 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:51.037919 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:28:51.037919 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: warnings.warn(msg) Jul 14 14:28:51.039118 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-1ab9d4c6-f085-4d3f-800e-606669869506 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:51.039562 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-1ab9d4c6-f085-4d3f-800e-606669869506 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:51.040349 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-1ab9d4c6-f085-4d3f-800e-606669869506 admin admin] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:51.040822 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-1ab9d4c6-f085-4d3f-800e-606669869506 admin admin] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:51.067148 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-1ab9d4c6-f085-4d3f-800e-606669869506 admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.085266 Jul 14 14:28:51.067724 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 38/74] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Jul 14 14:28:50 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:28:51.900571 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-f1539f64-00a5-43f1-bfe8-bef4fc195748 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:51.901652 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-f1539f64-00a5-43f1-bfe8-bef4fc195748 admin admin] 10.222.0.93 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jul 14 14:28:51.902086 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 37/75] 10.222.0.93 () {56 vars in 1074 bytes} [Thu Jul 14 14:28:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:28:52.103730 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG nova.api.openstack.wsgi [None req-6d580928-b674-4de5-b2a7-3a150d1dbe48 admin admin] Calling method '>' {{(pid=103722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:28:52.104932 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:28:52.104932 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: warnings.warn(msg) Jul 14 14:28:52.106172 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-6d580928-b674-4de5-b2a7-3a150d1dbe48 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:52.106603 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-6d580928-b674-4de5-b2a7-3a150d1dbe48 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:52.107915 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-6d580928-b674-4de5-b2a7-3a150d1dbe48 admin admin] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:28:52.108315 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: DEBUG oslo_concurrency.lockutils [None req-6d580928-b674-4de5-b2a7-3a150d1dbe48 admin admin] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:28:52.130574 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: INFO nova.api.openstack.requestlog [None req-6d580928-b674-4de5-b2a7-3a150d1dbe48 admin admin] 10.222.0.93 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078973 Jul 14 14:28:52.131134 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: [pid: 103722|app: 0|req: 39/76] 10.222.0.93 () {60 vars in 1193 bytes} [Thu Jul 14 14:28:52 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:29:47.902917 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: Thu Jul 14 14:29:47 2022 - graceful shutdown triggered... Jul 14 14:29:47.903430 dv-cinder-799871-30-iscsi devstack@n-api.service[103721]: Gracefully killing worker 1 (pid: 103721)... Jul 14 14:29:47.903029 dv-cinder-799871-30-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 14 14:29:47.904285 dv-cinder-799871-30-iscsi devstack@n-api.service[103722]: Gracefully killing worker 2 (pid: 103722)... Jul 14 14:29:48.904070 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: worker 1 buried after 1 seconds Jul 14 14:29:48.904070 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: worker 2 buried after 1 seconds Jul 14 14:29:48.904730 dv-cinder-799871-30-iscsi devstack@n-api.service[103720]: goodbye to uWSGI. Jul 14 14:29:48.905689 dv-cinder-799871-30-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 14 14:29:48.906273 dv-cinder-799871-30-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 14 14:29:48.909060 dv-cinder-799871-30-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 14:29:48.920381 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 14:29:48.922355 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 14:29:48 2022] *** Jul 14 14:29:48.922355 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 14:29:48.922355 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 14:29:48.922355 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: nodename: dv-cinder-799871-30-iscsi Jul 14 14:29:48.922355 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: machine: x86_64 Jul 14 14:29:48.922355 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: clock source: unix Jul 14 14:29:48.922355 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: pcre jit disabled Jul 14 14:29:48.922355 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: detected number of CPU cores: 4 Jul 14 14:29:48.922355 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: current working directory: / Jul 14 14:29:48.922355 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: detected binary path: /usr/bin/uwsgi-core Jul 14 14:29:48.922355 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: your processes number limit is 47680 Jul 14 14:29:48.923078 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: your memory page size is 4096 bytes Jul 14 14:29:48.923078 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: detected max file descriptor number: 2048 Jul 14 14:29:48.923078 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: lock engine: pthread robust mutexes Jul 14 14:29:48.923078 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: thunder lock: enabled Jul 14 14:29:48.923078 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 14:29:48.923078 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 14:29:48.967836 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: Python main interpreter initialized at 0x5646b38549c0 Jul 14 14:29:48.967836 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: python threads support enabled Jul 14 14:29:48.967836 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: your server socket listen backlog is limited to 100 connections Jul 14 14:29:48.967836 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: your mercy for graceful operations on workers is 90 seconds Jul 14 14:29:48.968255 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 14:29:48.968255 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: *** Operational MODE: preforking *** Jul 14 14:29:48.968572 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: *** uWSGI is running in multiple interpreter mode *** Jul 14 14:29:48.968744 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: spawned uWSGI master process (pid: 118444) Jul 14 14:29:48.969079 dv-cinder-799871-30-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 14:29:48.972131 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: spawned uWSGI worker 1 (pid: 118461, cores: 1) Jul 14 14:29:48.972131 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: spawned uWSGI worker 2 (pid: 118462, cores: 1) Jul 14 14:29:48.972131 dv-cinder-799871-30-iscsi devstack@n-api.service[118444]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 14:29:49.629259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 14:29:49.633991 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 14:29:50.851635 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:29:50.851635 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: from cryptography.utils import int_from_bytes Jul 14 14:29:50.852212 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:29:50.852212 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: from cryptography.utils import int_from_bytes Jul 14 14:29:50.853642 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:29:50.853642 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: from cryptography.utils import int_from_bytes Jul 14 14:29:50.854168 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:29:50.854168 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: from cryptography.utils import int_from_bytes Jul 14 14:29:53.200048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 14:29:53.200827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 14:29:53.201183 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 14:29:53.201671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 14:29:53.202006 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 14:29:53.202120 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 14:29:53.202330 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 14:29:53.202737 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.203074 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.203407 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.203682 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 14:29:53.203784 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.204064 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.204384 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.204714 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.204976 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 14:29:53.205084 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.205368 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.205636 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.205861 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 14:29:53.229420 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.229420 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-30-iscsi {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.230212 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.230841 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.230939 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.231043 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.231133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.231218 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.231299 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.231392 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.231472 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.231799 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.231889 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.231963 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.232048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.232129 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.232202 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.232202 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.232350 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.232444 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.232535 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.232616 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.232698 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.232771 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-30-iscsi {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.232850 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.232922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.233002 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.233083 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.233165 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.233248 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.233328 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.233409 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.233492 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.233565 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.233643 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.233716 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.234305 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.234457 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.234602 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.234737 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.234888 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-30-iscsi {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.235038 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.235179 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.235320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.235460 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.235593 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.235731 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.235874 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.235874 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.236124 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.236264 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.236407 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.236624 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.236815 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.237023 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.237172 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.237346 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.237480 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.237618 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.237889 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.237889 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.238195 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-30-iscsi {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.238344 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.238485 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.238631 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.238765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.238907 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.239041 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.239172 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.239963 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.240192 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.240295 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.240390 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.240484 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.240570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.240667 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.240761 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.240853 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.240945 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.241040 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.241126 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.241219 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.241311 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.241408 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.241494 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.241586 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.241711 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.241844 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.241943 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.242060 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.242149 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.242241 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.242340 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.242340 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.242502 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.242594 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.242688 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.242779 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.242877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.242877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.243050 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.243143 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.243228 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.243320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.243406 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.243497 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.243589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.243674 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.243764 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.243764 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.243933 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.244031 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.244123 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.244123 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.244289 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.244387 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.244481 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.244593 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.244734 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.244827 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.244926 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.245012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.245109 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.245195 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.245278 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.245369 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.245463 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.245557 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.245654 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.245747 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.245871 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.246309 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.246837 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.247078 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.247303 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.247408 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.247494 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.247588 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.247688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.247774 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.247857 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.247947 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.248040 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.248134 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.248226 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.248313 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.93 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.248405 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.248499 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.93 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.248888 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.249007 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.249098 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.249098 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.249261 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.249357 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.249450 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.249551 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.249646 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.249740 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.249869 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.249967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.250061 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.250157 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.250302 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.250436 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.250576 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.250721 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.251006 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.251263 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.251411 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.251546 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.251686 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.251828 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.252219 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.252322 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.252322 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.252487 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.252582 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.252582 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.252848 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.252988 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.252988 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.253148 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.253241 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.253334 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.253434 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.253434 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.253606 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.253692 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.253849 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.253963 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.253963 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.254139 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.254226 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.254323 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.254411 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.254411 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.254577 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.254669 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.254803 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.254897 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.254897 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.255060 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.255151 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.255244 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.255350 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.255436 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.255527 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.255619 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.255714 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.255807 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.255907 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.255992 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.256084 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.256168 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.256259 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.256344 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.256437 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.256522 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.256611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.256696 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.256779 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.256876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.256961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.257056 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.257149 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.257247 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.257342 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.257435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.257520 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.257611 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.257798 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.263026 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.263131 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.263221 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.263305 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.263379 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.263467 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.263542 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.263624 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.263706 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.263780 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.263851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.263931 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.264005 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.264084 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.264164 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.264238 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.265561 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.265654 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.265744 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.265868 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.266822 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.266917 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.267019 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.267117 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.267205 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.267289 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.267382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.267481 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.267577 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.267659 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.267740 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.267740 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.267890 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.267981 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.268081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.268168 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.268251 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.268343 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.268432 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.268530 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.268617 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.268708 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.268802 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.268895 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.268990 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.269088 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.269182 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.269275 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.269361 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.269448 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:29:53.269542 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.269637 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.269730 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.269984 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.270083 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.270083 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.270498 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.270498 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.270806 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.270897 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.271010 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.271010 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.271195 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.271195 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.271609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.271706 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.271793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.271877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.271969 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.272063 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.272151 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.272235 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.272396 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.272499 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.272598 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.272698 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.272792 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.272894 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.272988 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.273074 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.273167 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.273267 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.273361 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.273447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.273545 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.273639 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.273743 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.274066 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.274158 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.274327 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.274422 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.274508 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.274601 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.274697 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.274845 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.274936 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.275020 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.275111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.275206 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.275293 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.275385 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.275478 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.275478 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.275478 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.275721 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.275815 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.275901 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.275993 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.275993 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.276157 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.276253 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.276349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.276436 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.276528 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.276625 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.276719 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.276845 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.276951 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.277043 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.277140 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.277296 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.277400 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.277496 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.277583 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.277677 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.277787 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.277876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.277975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.278063 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.278154 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.278241 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.278325 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.278417 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.278512 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.278606 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.278702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.278788 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.278882 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.279015 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.279118 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.279218 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.279313 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.279399 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.279492 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.279591 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.279685 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.279779 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.279865 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.280090 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.280245 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.280353 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.280510 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.280605 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.280691 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.280841 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.280943 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.281082 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.281216 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.281319 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.281465 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.281612 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.281716 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.281716 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.281924 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.281924 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.282090 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.282174 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.282323 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.282420 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.282551 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.282644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.282737 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.282825 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.282928 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.283015 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.283107 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.283190 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.283263 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.283334 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.283430 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.283517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.283590 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.283660 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.283730 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.283800 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.283884 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.283977 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.284071 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.284157 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.284249 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.284354 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.284441 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.284525 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.284617 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.284703 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.284794 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.284888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.284975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.285068 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.285177 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.285288 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.285429 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.285554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.285649 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.285734 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.285849 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.285951 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.286040 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.286133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.286227 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.286322 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.286425 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.286519 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.286608 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.286695 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.286780 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.286873 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.286969 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.287064 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.287165 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.287252 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.287345 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.287439 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.287526 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.287618 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.287703 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.287796 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.287894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.287981 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.288072 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.288158 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.288255 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.288350 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.288443 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.288538 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.288625 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.288723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.288810 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.288894 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.288987 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.289069 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.289149 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.289243 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.289337 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.289430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.289516 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.289609 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.289695 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.290015 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.290124 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.290212 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.290305 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.290391 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.290482 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.290629 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.290731 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.290866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.290988 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.291089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.291231 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.291326 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.291412 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.291538 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.291638 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.291772 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.291896 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.292017 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.292132 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.292243 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.292412 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.292505 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.292598 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.292736 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.293347 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.293441 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.293535 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.293621 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.293718 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.297382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.297519 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.297621 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.297718 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.297831 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.297932 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.298028 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.298123 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.298218 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.298314 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.298409 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.298496 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.298587 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.298682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.298776 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.298859 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.298940 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.299027 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.299120 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.299259 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.299362 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.299450 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.299545 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.299639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.299727 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.299812 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.299895 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.299988 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.300088 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.300175 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.300259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.300343 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.300434 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.300530 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.300646 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.300730 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.300804 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.300888 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.300972 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.301109 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.301213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.301339 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.301432 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.301525 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.301600 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.301680 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.301754 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.301915 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.302010 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.302104 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.302198 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.302299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.302428 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.302521 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.302620 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.302802 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.302928 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.303033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.303128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.303215 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.303299 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.303391 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.303490 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.303578 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.303668 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.303762 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.303849 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.303934 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.304031 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.304118 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.304210 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.304210 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.304382 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.304467 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.304632 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.304720 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.304812 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.304898 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.304984 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.304984 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.305153 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.305239 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.305322 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.305413 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.305507 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.305605 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.305692 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.305692 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.305874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.305973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.306098 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.306198 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.306285 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.306376 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.306469 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.306563 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.306649 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.306746 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.306832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.306916 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.307000 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.307081 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.307166 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.307263 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.307357 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.307450 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.307589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.307691 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.307787 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.307873 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.307966 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.308052 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.308136 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.308219 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.308312 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.308406 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.308552 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.308643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.308728 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.308812 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.308958 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.309056 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.309144 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.309228 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.309363 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.309463 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.309563 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.309658 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.309827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.309932 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.310027 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.310123 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.310217 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.310311 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.310311 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.310488 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.310588 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.310688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.310775 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.310856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.310942 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.311035 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.311120 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.311300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.311449 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.311571 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.311694 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.311694 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.311924 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.312046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.312160 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.312273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.312386 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.312508 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.312635 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.312749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.312869 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.312982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.313105 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.313280 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.313454 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.313599 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.313801 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.313963 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.314121 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.314244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.314437 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.314539 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.314755 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.314860 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.315071 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.315173 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.315400 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.315503 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.315725 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.315829 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.316036 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.316137 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.316353 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.316460 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.316659 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.316752 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.316961 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.317102 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.317260 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.317355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.317570 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.317777 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.323425 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.323560 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.323674 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.323764 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.323851 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.323936 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.324032 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.324173 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.324270 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.324366 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.324454 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.324546 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.324546 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.324715 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.324811 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.324899 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.324991 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.325084 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.325180 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.325319 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.325416 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.325510 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.325593 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.325679 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.325792 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.325936 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.326027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.326112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.326204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.326290 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.326382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.326480 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.326630 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.326723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.326817 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.326904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.327003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.327090 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.327182 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.327269 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.327361 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.327454 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.327554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.327649 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.327735 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.327828 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.327921 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.328015 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.328110 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.328197 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.328281 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.328374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.328461 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.328556 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.328656 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.328750 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.328836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.328920 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.329011 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.329109 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.329203 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.329289 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.329413 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.329499 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.329572 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.329656 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.329757 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.329873 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.329960 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.330033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.330103 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.330249 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.330349 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.330436 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.330520 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.330603 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.330695 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.330790 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.330886 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.331044 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.331137 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.331223 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.331319 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.331414 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.331509 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.331596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.331688 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.331775 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.331868 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.332030 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.332235 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.332338 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.332426 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.332510 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.332615 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.332763 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.332862 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.332949 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.333042 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.333136 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.333372 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.333504 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.333595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.333688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.333843 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.333948 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.334036 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.334121 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.334214 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.334309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.334404 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.334621 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.334727 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.334934 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.335040 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.335243 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.335346 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.335544 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.335640 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.335849 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.335954 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.336154 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.336255 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.336462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.336558 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.336772 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.336866 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.337073 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.337177 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.337380 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.337490 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.337682 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.337798 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.338008 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.338113 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.338310 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.338404 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.338616 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.338709 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.338915 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.339019 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.339216 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.339310 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.339516 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.339614 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.340339 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.340453 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.340645 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.340747 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.340968 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.341067 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.341277 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.341375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.341574 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.341676 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.341914 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.342024 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.342275 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.342392 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.342559 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.342663 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.342862 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.342958 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.343170 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.343263 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.343506 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.343659 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.343816 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.343934 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.344129 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.344225 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.344437 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.344532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.344746 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.344848 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.345055 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.345157 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.345356 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.345452 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.345666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.345792 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.346001 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.346105 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.346309 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.346403 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.346611 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.346719 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.346914 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.347015 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.347229 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.347330 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.347538 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.347641 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.347847 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.347948 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.348163 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.348301 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.348480 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.348619 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.348793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.348916 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.349110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.349234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.349426 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.349558 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.349736 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.349895 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.350091 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.350184 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.350406 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.350508 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.350714 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.350809 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.351024 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.351120 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.351332 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.351426 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.351642 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.351743 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.351949 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.352044 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.352255 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.352474 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.352571 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.352705 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.352886 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.353049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.353196 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.353361 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.353546 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.353736 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.353919 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.354023 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.354189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.354322 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.354493 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.354640 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.354800 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.354949 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.355101 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.355435 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.355593 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.355748 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.355845 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.356066 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.356183 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.356384 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.356488 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.356950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.357104 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.357261 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.357364 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.357577 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.357672 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.357929 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.358042 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.358241 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.358335 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.358550 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.358643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.358852 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.358959 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.359175 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.359267 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.359486 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.359588 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.359812 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.359916 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.360161 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.360253 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.360464 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.360566 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.360766 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.360861 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.361074 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.361244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.361395 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.361563 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.361699 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.361905 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.362048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.362238 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.362378 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.362578 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.362723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.362909 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.363019 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.363219 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.363323 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.363627 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.363752 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.363843 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.363960 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.364168 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.364275 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.364497 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.364665 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.364810 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.364980 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.365132 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.365295 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.365439 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.365618 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.365988 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.366096 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.366284 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.366400 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.366588 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.366691 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.366917 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.367021 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.367206 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.367330 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.367528 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.367663 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.367849 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.367980 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.368157 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.368311 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.368469 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.368642 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.368771 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.368954 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.369092 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.369265 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.369411 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.369581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.369721 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.369919 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.370083 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.370250 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.370496 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.370599 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.370816 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.371455 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.371637 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.371736 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.371957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.372055 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.372280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.372393 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.372702 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.372824 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.372921 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.373018 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.373173 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.373283 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.373474 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.373587 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.373812 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.373942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.374115 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.374214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.374419 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.374576 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.374726 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.374829 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.375033 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.375140 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.375338 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.375433 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.375639 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.375733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.375941 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.376045 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.376263 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.376367 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.376564 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.376665 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.376909 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.377003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.377224 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.377340 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.377611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.377791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.377919 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.380662 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.380662 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.380912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.381104 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.381211 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.381299 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.381384 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.381476 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.381563 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.381647 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.381741 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.381869 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.381958 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.382041 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.382126 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.382209 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.382302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.382397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.382472 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.382555 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.382636 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.382881 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.382985 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.383080 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.383176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.383262 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.383346 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.383441 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.383536 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.383623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.383716 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.383802 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.383942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.384052 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.384181 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.384282 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.384370 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.384463 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.384550 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.384644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.384739 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.384826 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.384911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.384995 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.385076 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.385169 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.385256 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.385340 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.385433 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.385528 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.385675 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.385784 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.385873 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.386012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.386182 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.386336 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.386509 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.386680 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.386891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.386994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.387226 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.387322 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.387544 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.387641 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.387872 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.387968 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.388170 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.388277 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.388517 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.388635 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.388801 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.388895 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.389127 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.389286 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.389440 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.389542 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.389757 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.389899 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.390104 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.390262 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.390409 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.390502 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.390730 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.390831 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.391042 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.391149 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.391354 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.391457 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.391669 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.391898 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.392047 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.392231 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.392329 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.392557 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.392660 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.393000 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.393164 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.393258 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.393352 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.393502 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.393596 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.393848 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.393969 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.394168 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.394299 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.394486 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.394730 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.394833 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.395060 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.395158 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.395374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.395477 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.395688 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.395792 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.396002 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.396106 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.396316 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.396409 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.396626 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.396729 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.396940 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.397075 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.397249 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.397345 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.397559 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.397664 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.397900 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.397999 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.398227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.398324 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.398547 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.398643 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.398871 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.398973 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.399193 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.399285 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.399507 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.399601 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.399819 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.399913 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.400134 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.400243 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.400445 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.400539 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.400761 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.400862 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.401077 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.401182 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.401392 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.401494 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.401702 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.401818 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.402043 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.402140 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.402879 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.403052 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.403253 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.403356 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.403490 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.403588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.403801 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.403890 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.404112 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.404256 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.404422 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.404519 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.404731 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.404954 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.405051 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.405276 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.405380 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.405617 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.405712 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.405973 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.406070 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.406298 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.406391 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.406609 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.406704 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.406919 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.407013 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.407233 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.407336 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.407548 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.407749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.407844 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.408063 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.408171 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.408529 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.409022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.409187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.409340 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.409506 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.409656 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.409750 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.409882 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.409976 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.410063 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.410151 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.410238 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.410322 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.410395 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.410666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.410853 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.410979 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.411213 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.411308 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.411536 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.411637 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.411870 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.411978 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.412183 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.412276 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.412484 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.412577 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.412802 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.412906 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.413110 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.413209 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.413436 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.413640 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.413750 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.414013 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.414108 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.414324 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.414440 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.414646 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.414758 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.414970 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.415074 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.415285 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.415379 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.415589 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.415696 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.415898 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.415991 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.416202 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.416302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.416505 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.416600 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.416816 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.416956 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.417126 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.417221 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.417457 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.417578 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.417719 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.417861 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.418112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.418206 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.418421 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.418516 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.418724 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.418831 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.419032 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.419125 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.419333 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.419436 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.419647 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.419754 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.419951 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.420054 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.420258 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.420353 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.420561 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.420664 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.420869 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.420974 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.421170 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.421273 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.421471 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.421565 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.421819 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.421933 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.422095 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.422191 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.422405 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.422505 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.422784 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.422946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.423095 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.423228 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.423494 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.423611 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.423742 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.423884 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.424058 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.424199 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.424375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.424513 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.424730 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.424865 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.425052 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.425182 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.425488 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.425592 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.425843 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.425970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.426162 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.426295 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.426473 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.426633 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.426796 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.426968 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.427117 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.427281 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.427404 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.427591 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.427748 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.427899 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.428063 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.428226 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.428543 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.428646 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.428859 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.428962 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.429172 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.429277 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.429484 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.429602 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.429819 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.429916 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.430136 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.430240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.430451 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.430547 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.430767 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.430861 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.431080 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.431174 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.431389 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.431484 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.431702 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.431805 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.432013 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.432107 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.432322 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.432476 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.432635 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.432743 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.432945 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.433047 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.433254 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.433403 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.434139 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.434251 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.434405 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.434517 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.434714 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.434822 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.435028 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.435137 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.435336 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.435448 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.435645 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.435755 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.435958 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.436054 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.436296 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.436400 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.436612 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.436706 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.436926 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.437022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.437234 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.437336 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.437547 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.437662 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.437880 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.438007 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.438189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.438335 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.438497 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.438662 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.438803 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.438978 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.439115 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.439308 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.439544 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.439686 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.439894 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.440000 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.440210 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.440320 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.440629 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.440733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.440942 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.441051 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.441262 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.441369 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.441582 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.441685 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.441919 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.442029 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.442244 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.442340 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.442563 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.442659 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.442873 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.442981 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.443189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.443283 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.443498 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.443644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.443815 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.443910 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.444179 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.444295 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.444435 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.444538 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.444752 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.444860 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.445068 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.445186 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.445374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.445480 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.445677 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.445804 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.446009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.446104 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.446326 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.446435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.446633 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.446726 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.446938 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.447033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.447241 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.447345 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.447551 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.447655 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.447851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.447957 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.448154 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.448262 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.448456 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.448551 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.448759 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.448853 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.449084 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.449212 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.449419 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.449512 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.449721 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.449849 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.450053 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.450149 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.450355 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.450457 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.450657 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.450759 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.450959 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.451054 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.451266 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.451369 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.451568 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.451672 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.451869 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.451965 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.452167 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.452270 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.452467 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.452571 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.452769 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.452878 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.453099 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.453202 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.453429 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.453533 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.453743 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.453903 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.454087 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.454190 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.454398 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.454515 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.454714 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.454808 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.455050 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.455923 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.455923 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.456116 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.456206 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.456292 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.456377 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.456471 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.456573 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.456662 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.456748 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.456904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.457001 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.457230 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.457335 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.457541 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.457637 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.457875 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.457974 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.458187 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.458301 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.458499 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.458603 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.458825 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.458920 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.459139 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.459242 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.459445 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.459539 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.459760 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.459862 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.460078 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.460173 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.460392 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.460484 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.460703 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.460809 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.461012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.461125 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.461326 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.461428 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.461639 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.461901 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.461994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.462080 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.462287 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.462383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.462601 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.462706 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.462911 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.463018 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.463225 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.463329 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.463535 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.463640 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.463845 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.463948 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.464160 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.464264 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.464482 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.464599 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.465318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.465419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.465646 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.465741 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.465984 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.466083 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.466314 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.466409 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.466598 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 14:29:53.466692 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.466972 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.467285 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.467628 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.467959 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.468275 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.468588 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.468894 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:29:53.469135 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 14:29:53.625133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO dbcounter [None req-72fc2bd2-106d-4213-bce8-67e71424ea04 None None] Registered counter for database nova_api Jul 14 14:29:53.625729 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO dbcounter [None req-31e8688c-d4bc-4b64-a42c-036ec0158604 None None] Registered counter for database nova_api Jul 14 14:29:53.645242 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_db.sqlalchemy.engines [None req-72fc2bd2-106d-4213-bce8-67e71424ea04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:29:53.646859 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_db.sqlalchemy.engines [None req-31e8688c-d4bc-4b64-a42c-036ec0158604 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:29:53.652045 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writer thread running {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:29:53.654510 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writer thread running {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:29:53.709628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.context [None req-72fc2bd2-106d-4213-bce8-67e71424ea04 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ee12dd37-6f17-45ed-8af9-e0df6fe4a856(cell1) {{(pid=118461) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 14:29:53.713682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-72fc2bd2-106d-4213-bce8-67e71424ea04 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:53.713908 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.context [None req-31e8688c-d4bc-4b64-a42c-036ec0158604 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ee12dd37-6f17-45ed-8af9-e0df6fe4a856(cell1) {{(pid=118462) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 14:29:53.715899 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-72fc2bd2-106d-4213-bce8-67e71424ea04 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:53.716743 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-72fc2bd2-106d-4213-bce8-67e71424ea04 None None] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:53.718812 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-72fc2bd2-106d-4213-bce8-67e71424ea04 None None] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:53.719081 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-31e8688c-d4bc-4b64-a42c-036ec0158604 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:53.720655 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-31e8688c-d4bc-4b64-a42c-036ec0158604 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:53.720811 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO dbcounter [None req-72fc2bd2-106d-4213-bce8-67e71424ea04 None None] Registered counter for database nova_cell0 Jul 14 14:29:53.721469 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-31e8688c-d4bc-4b64-a42c-036ec0158604 None None] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:29:53.723511 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-31e8688c-d4bc-4b64-a42c-036ec0158604 None None] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:29:53.724981 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO dbcounter [None req-72fc2bd2-106d-4213-bce8-67e71424ea04 None None] Registered counter for database nova_cell1 Jul 14 14:29:53.725514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO dbcounter [None req-31e8688c-d4bc-4b64-a42c-036ec0158604 None None] Registered counter for database nova_cell0 Jul 14 14:29:53.729642 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO dbcounter [None req-31e8688c-d4bc-4b64-a42c-036ec0158604 None None] Registered counter for database nova_cell1 Jul 14 14:29:53.733329 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_db.sqlalchemy.engines [None req-72fc2bd2-106d-4213-bce8-67e71424ea04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:29:53.734310 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_db.sqlalchemy.engines [None req-72fc2bd2-106d-4213-bce8-67e71424ea04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:29:53.737118 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_db.sqlalchemy.engines [None req-31e8688c-d4bc-4b64-a42c-036ec0158604 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:29:53.739031 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_db.sqlalchemy.engines [None req-31e8688c-d4bc-4b64-a42c-036ec0158604 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:29:53.742251 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writer thread running {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:29:53.742586 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writer thread running {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:29:53.746401 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writer thread running {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:29:53.747783 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writer thread running {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:29:53.892490 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO dbcounter [None req-72fc2bd2-106d-4213-bce8-67e71424ea04 None None] Registered counter for database nova_cell0 Jul 14 14:29:53.900723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_db.sqlalchemy.engines [None req-72fc2bd2-106d-4213-bce8-67e71424ea04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:29:53.906160 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writer thread running {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:29:53.917378 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO dbcounter [None req-31e8688c-d4bc-4b64-a42c-036ec0158604 None None] Registered counter for database nova_cell0 Jul 14 14:29:53.926716 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_db.sqlalchemy.engines [None req-31e8688c-d4bc-4b64-a42c-036ec0158604 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:29:53.931558 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writer thread running {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:29:54.227776 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: WARNING keystonemiddleware.auth_token [None req-72fc2bd2-106d-4213-bce8-67e71424ea04 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:29:54.235898 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: WARNING keystonemiddleware.auth_token [None req-72fc2bd2-106d-4213-bce8-67e71424ea04 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:29:54.267124 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: WARNING keystonemiddleware.auth_token [None req-31e8688c-d4bc-4b64-a42c-036ec0158604 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:29:54.275141 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: WARNING keystonemiddleware.auth_token [None req-31e8688c-d4bc-4b64-a42c-036ec0158604 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:29:54.580021 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: WARNING keystonemiddleware.auth_token [None req-72fc2bd2-106d-4213-bce8-67e71424ea04 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:29:54.586026 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: WARNING keystonemiddleware.auth_token [None req-72fc2bd2-106d-4213-bce8-67e71424ea04 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:29:54.592764 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5646b38549c0 pid: 118461 (default app) Jul 14 14:29:54.619776 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: WARNING keystonemiddleware.auth_token [None req-31e8688c-d4bc-4b64-a42c-036ec0158604 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:29:54.625793 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: WARNING keystonemiddleware.auth_token [None req-31e8688c-d4bc-4b64-a42c-036ec0158604 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:29:54.631954 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5646b38549c0 pid: 118462 (default app) Jul 14 14:30:35.765195 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=3 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:35.766200 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=3 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:35.766865 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=3 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:35.767698 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=3 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:37.280706 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=3 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:37.281436 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=3 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:37.283932 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=3 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:37.284685 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=3 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:30:37.475572 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-8ac79c7a-0d50-4602-ac7e-70b23c27fab9 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] Action: 'create', calling method: .version_select at 0x7f416dcfeca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-111800369", "metadata": {"Type": "work"}}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-8ac79c7a-0d50-4602-ac7e-70b23c27fab9 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] Request method failure captured: Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 121 Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0CiLmv4rR3ON79UB10Tgqdvu4OKIGrk7n9PwzPQrtHPrqpfZxpsyVck4g6BTXeOKCry6mZj3F1maxIYGRJke-UZj9xN0GHQm5xB9TkF4W9EgAzq0MpCjkqA8JgOIvu7PdbXJ2gxEM3Ly_xXCxoJc__O2rekR9dImKDTJcj_LaR3MPZM Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: 00aaa9fa0a0949188f8a80bf052d8105 Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-VolumesNegativeTest-950114477 Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:30:37.493099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:30:37.494917 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:30:37.494917 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-VolumesNegativeTest-950114477 Jul 14 14:30:37.494917 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: 00aaa9fa0a0949188f8a80bf052d8105 Jul 14 14:30:37.494917 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-VolumesNegativeTest-950114477 Jul 14 14:30:37.494917 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-VolumesNegativeTest-950114477-project Jul 14 14:30:37.494917 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:30:37.494917 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:30:37.494917 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: 097d2584618a4292ac559e83a321669b Jul 14 14:30:37.494917 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-VolumesNegativeTest-950114477-project Jul 14 14:30:37.494917 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Jul 14 14:30:37.494917 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-111800369", "metadata": {"Type": "work"}}} Jul 14 14:30:37.494917 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: Jul 14 14:30:37.494917 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-111800369', 'metadata': {'Type': 'work'}}}} Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi '#$%' Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:37.495904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:37.497415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:30:37.497415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:30:37.497415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:37.497415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:37.497415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:30:37.497415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:30:37.497415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:30:37.497415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:30:37.497415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:30:37.497415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:30:37.497415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 14:30:37.497415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.497415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:37.497415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.497415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:37.497415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:37.497415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:37.497415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:30:37.497415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:30:37.502229 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 14:30:37.502229 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.502229 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-8ac79c7a-0d50-4602-ac7e-70b23c27fab9 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:37.502229 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-8ac79c7a-0d50-4602-ac7e-70b23c27fab9 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.755105 Jul 14 14:30:37.502229 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 1/1] 10.222.0.93 () {60 vars in 1155 bytes} [Thu Jul 14 14:30:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1759 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:30:37.516178 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4da5c9c4-eec4-4dc9-bf17-3486540c848e tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] Action: 'create', calling method: .version_select at 0x7f416dc21f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-895880865", "metadata": {"Type": "work"}}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4da5c9c4-eec4-4dc9-bf17-3486540c848e tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] Request method failure captured: Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 119 Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0CiLmv4rR3ON79UB10Tgqdvu4OKIGrk7n9PwzPQrtHPrqpfZxpsyVck4g6BTXeOKCry6mZj3F1maxIYGRJke-UZj9xN0GHQm5xB9TkF4W9EgAzq0MpCjkqA8JgOIvu7PdbXJ2gxEM3Ly_xXCxoJc__O2rekR9dImKDTJcj_LaR3MPZM Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: 00aaa9fa0a0949188f8a80bf052d8105 Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-VolumesNegativeTest-950114477 Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:30:37.519049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:30:37.520726 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:30:37.520726 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-VolumesNegativeTest-950114477 Jul 14 14:30:37.520726 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: 00aaa9fa0a0949188f8a80bf052d8105 Jul 14 14:30:37.520726 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-VolumesNegativeTest-950114477 Jul 14 14:30:37.520726 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-VolumesNegativeTest-950114477-project Jul 14 14:30:37.520726 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:30:37.520726 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:30:37.520726 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: 097d2584618a4292ac559e83a321669b Jul 14 14:30:37.520726 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-VolumesNegativeTest-950114477-project Jul 14 14:30:37.520726 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Jul 14 14:30:37.520726 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-895880865", "metadata": {"Type": "work"}}} Jul 14 14:30:37.520726 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: Jul 14 14:30:37.520726 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-895880865', 'metadata': {'Type': 'work'}}}} Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi '0' Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:37.521541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:37.522856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:30:37.522856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:30:37.522856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:37.522856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:37.522856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:30:37.522856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:30:37.522856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:30:37.522856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:30:37.522856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:30:37.522856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:30:37.522856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 14:30:37.522856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.522856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:37.522856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.522856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:37.522856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:37.522856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:37.522856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:30:37.522856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:30:37.523987 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 14:30:37.523987 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.523987 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4da5c9c4-eec4-4dc9-bf17-3486540c848e tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:37.523987 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4da5c9c4-eec4-4dc9-bf17-3486540c848e tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011898 Jul 14 14:30:37.523987 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 2/2] 10.222.0.93 () {60 vars in 1155 bytes} [Thu Jul 14 14:30:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:30:37.532512 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0df5fdb3-7705-4502-9d79-181bb4e26a49 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] Action: 'create', calling method: .version_select at 0x7f416dc210d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-830009832", "metadata": {"Type": "work"}}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0df5fdb3-7705-4502-9d79-181bb4e26a49 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] Request method failure captured: Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 118 Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0CiLmv4rR3ON79UB10Tgqdvu4OKIGrk7n9PwzPQrtHPrqpfZxpsyVck4g6BTXeOKCry6mZj3F1maxIYGRJke-UZj9xN0GHQm5xB9TkF4W9EgAzq0MpCjkqA8JgOIvu7PdbXJ2gxEM3Ly_xXCxoJc__O2rekR9dImKDTJcj_LaR3MPZM Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: 00aaa9fa0a0949188f8a80bf052d8105 Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-VolumesNegativeTest-950114477 Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:30:37.536088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:30:37.537592 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:30:37.537592 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-VolumesNegativeTest-950114477 Jul 14 14:30:37.537592 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: 00aaa9fa0a0949188f8a80bf052d8105 Jul 14 14:30:37.537592 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-VolumesNegativeTest-950114477 Jul 14 14:30:37.537592 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-VolumesNegativeTest-950114477-project Jul 14 14:30:37.537592 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:30:37.537592 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:30:37.537592 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: 097d2584618a4292ac559e83a321669b Jul 14 14:30:37.537592 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-VolumesNegativeTest-950114477-project Jul 14 14:30:37.537592 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Jul 14 14:30:37.537592 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-830009832", "metadata": {"Type": "work"}}} Jul 14 14:30:37.537592 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: Jul 14 14:30:37.537592 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-830009832', 'metadata': {'Type': 'work'}}}} Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi '' Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:37.538671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:37.540063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:30:37.540063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:30:37.540063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:37.540063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:37.540063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:30:37.540063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:30:37.540063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:30:37.540063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:30:37.540063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:30:37.540063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:30:37.540063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 14:30:37.540063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.540063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:37.540063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.540063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:37.540063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:37.540063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:37.540063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:30:37.540063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:30:37.541121 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 14:30:37.541121 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:37.541121 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0df5fdb3-7705-4502-9d79-181bb4e26a49 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:37.541121 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-0df5fdb3-7705-4502-9d79-181bb4e26a49 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009212 Jul 14 14:30:37.541121 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 3/3] 10.222.0.93 () {60 vars in 1155 bytes} [Thu Jul 14 14:30:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:30:37.559742 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c601663e-6181-4b22-bcde-b1e9dceb3593 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] Calling method '.version_select at 0x7f416dbc0ca0>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:38.510034 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c6630851-a9f2-4aa4-a227-7d7e77484d94 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Action: 'create', calling method: .version_select at 0x7f416dd01ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1040139656"}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:39.198483 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-c601663e-6181-4b22-bcde-b1e9dceb3593 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] HTTP exception thrown: Volume tempest-invalid-1140386877 could not be found. Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c601663e-6181-4b22-bcde-b1e9dceb3593 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] Request method failure captured: Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1140386877 HTTP/1.1 Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0CiLmv4rR3ON79UB10Tgqdvu4OKIGrk7n9PwzPQrtHPrqpfZxpsyVck4g6BTXeOKCry6mZj3F1maxIYGRJke-UZj9xN0GHQm5xB9TkF4W9EgAzq0MpCjkqA8JgOIvu7PdbXJ2gxEM3Ly_xXCxoJc__O2rekR9dImKDTJcj_LaR3MPZM Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: 00aaa9fa0a0949188f8a80bf052d8105 Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-VolumesNegativeTest-950114477 Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:30:39.202288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:30:39.203737 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:30:39.203737 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-VolumesNegativeTest-950114477 Jul 14 14:30:39.203737 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: 00aaa9fa0a0949188f8a80bf052d8105 Jul 14 14:30:39.203737 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-VolumesNegativeTest-950114477 Jul 14 14:30:39.203737 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-VolumesNegativeTest-950114477-project Jul 14 14:30:39.203737 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:30:39.203737 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:30:39.203737 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: 097d2584618a4292ac559e83a321669b Jul 14 14:30:39.203737 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-VolumesNegativeTest-950114477-project Jul 14 14:30:39.203737 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: Jul 14 14:30:39.203737 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Volume tempest-invalid-1140386877 could not be found. Jul 14 14:30:39.203737 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': 'tempest-invalid-1140386877'} Jul 14 14:30:39.203737 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:39.204683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:39.204683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:30:39.204683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:30:39.204683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 14:30:39.204683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 14:30:39.204683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 14:30:39.204683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 14:30:39.204683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 14:30:39.204683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 14:30:39.204683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 14:30:39.204683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 14:30:39.204683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:30:39.204683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:30:39.204683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:30:39.204683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:30:39.204683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1140386877 could not be found. (HTTP 404) (Request-ID: req-11a78038-241b-4591-919c-6e142e5d6cc1) Jul 14 14:30:39.204683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:39.204683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:39.204683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:39.206038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:39.206038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 14:30:39.206038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 14:30:39.206038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:30:39.206038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:30:39.206038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:30:39.206038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:30:39.206038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:30:39.206038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:30:39.206038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:30:39.206038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:30:39.206038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 14:30:39.206038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 14:30:39.206038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 14:30:39.206038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 14:30:39.206038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 14:30:39.206038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 14:30:39.206038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 14:30:39.206038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1140386877 could not be found. Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:30:39.207299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1140386877 could not be found. Jul 14 14:30:39.208594 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:39.208594 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:39.208594 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:39.208594 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:39.208594 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:39.208594 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:39.208594 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:30:39.208594 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:30:39.208594 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1140386877 could not be found. Jul 14 14:30:39.208594 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:39.211762 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c601663e-6181-4b22-bcde-b1e9dceb3593 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] Returning 404 to user: Volume tempest-invalid-1140386877 could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:39.213223 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c601663e-6181-4b22-bcde-b1e9dceb3593 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1140386877" status: 404 len: 99 microversion: 2.1 time: 1.666750 Jul 14 14:30:39.214362 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 4/4] 10.222.0.93 () {58 vars in 1217 bytes} [Thu Jul 14 14:30:37 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1140386877 => generated 99 bytes in 1668 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:30:39.471591 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d984a5d8-79d2-46a2-b855-175820b141db tempest-VolumesGetTestJSON-1873191104 tempest-VolumesGetTestJSON-1873191104-project] Action: 'create', calling method: .version_select at 0x7f416dadaa60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-902466006", "metadata": {"Type": "work"}}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:41.756893 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d984a5d8-79d2-46a2-b855-175820b141db tempest-VolumesGetTestJSON-1873191104 tempest-VolumesGetTestJSON-1873191104-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.541173 Jul 14 14:30:41.758570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 5/5] 10.222.0.93 () {60 vars in 1155 bytes} [Thu Jul 14 14:30:39 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2543 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 14:30:41.785152 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-7b7b9bb1-1f08-47e2-95c6-bdd915abefc9 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012220 Jul 14 14:30:41.785152 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 6/6] 10.222.0.93 () {58 vars in 1139 bytes} [Thu Jul 14 14:30:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 14:30:41.801424 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d29b972b-1f61-4be1-bcd9-d9539b215d35 tempest-VolumesGetTestJSON-1873191104 tempest-VolumesGetTestJSON-1873191104-project] Calling method '.version_select at 0x7f416dada820>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:41.833440 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c6630851-a9f2-4aa4-a227-7d7e77484d94 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.569340 Jul 14 14:30:41.834149 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 1/7] 10.222.0.93 () {60 vars in 1154 bytes} [Thu Jul 14 14:30:37 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4572 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 14:30:41.850982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-8a397237-1231-4adb-ba6c-8ad64391ead1 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004359 Jul 14 14:30:41.850982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 2/8] 10.222.0.93 () {58 vars in 1136 bytes} [Thu Jul 14 14:30:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 14:30:41.864545 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-8768164a-c01c-4aea-9093-5f8e24074a49 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416db5cd30>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:42.078828 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d29b972b-1f61-4be1-bcd9-d9539b215d35 tempest-VolumesGetTestJSON-1873191104 tempest-VolumesGetTestJSON-1873191104-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/aab846f3-c358-4583-8732-0dc5eac6b2e1" status: 200 len: 352 microversion: 2.1 time: 0.294607 Jul 14 14:30:42.084976 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 7/9] 10.222.0.93 () {58 vars in 1244 bytes} [Thu Jul 14 14:30:41 2022] GET /compute/v2.1/os-volumes/aab846f3-c358-4583-8732-0dc5eac6b2e1 => generated 352 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:42.092078 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0b5b569e-6bfd-4158-9770-aa80ed77cce1 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] Calling method '.version_select at 0x7f416daff550>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:42.129873 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-8768164a-c01c-4aea-9093-5f8e24074a49 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549" status: 200 len: 345 microversion: 2.1 time: 0.287446 Jul 14 14:30:42.137220 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 3/10] 10.222.0.93 () {58 vars in 1244 bytes} [Thu Jul 14 14:30:41 2022] GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549 => generated 345 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:42.577272 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-0b5b569e-6bfd-4158-9770-aa80ed77cce1 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] HTTP exception thrown: Volume 972976f8-9e27-41f2-b2d2-45fe7f8dae42 could not be found. Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0b5b569e-6bfd-4158-9770-aa80ed77cce1 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] Request method failure captured: Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: DELETE /compute/v2.1/os-volumes/972976f8-9e27-41f2-b2d2-45fe7f8dae42 HTTP/1.1 Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0CiLmv4rR3ON79UB10Tgqdvu4OKIGrk7n9PwzPQrtHPrqpfZxpsyVck4g6BTXeOKCry6mZj3F1maxIYGRJke-UZj9xN0GHQm5xB9TkF4W9EgAzq0MpCjkqA8JgOIvu7PdbXJ2gxEM3Ly_xXCxoJc__O2rekR9dImKDTJcj_LaR3MPZM Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: 00aaa9fa0a0949188f8a80bf052d8105 Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-VolumesNegativeTest-950114477 Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:30:42.579282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:30:42.580271 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:30:42.580271 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-VolumesNegativeTest-950114477 Jul 14 14:30:42.580271 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: 00aaa9fa0a0949188f8a80bf052d8105 Jul 14 14:30:42.580271 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-VolumesNegativeTest-950114477 Jul 14 14:30:42.580271 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-VolumesNegativeTest-950114477-project Jul 14 14:30:42.580271 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:30:42.580271 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:30:42.580271 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: 097d2584618a4292ac559e83a321669b Jul 14 14:30:42.580271 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-VolumesNegativeTest-950114477-project Jul 14 14:30:42.580271 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: Jul 14 14:30:42.580271 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Volume 972976f8-9e27-41f2-b2d2-45fe7f8dae42 could not be found. Jul 14 14:30:42.580271 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': '972976f8-9e27-41f2-b2d2-45fe7f8dae42'} Jul 14 14:30:42.580271 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:42.580894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:42.580894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:30:42.580894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:30:42.580894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 14:30:42.580894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 14:30:42.580894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 14:30:42.580894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 14:30:42.580894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 14:30:42.580894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 14:30:42.580894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 14:30:42.580894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 14:30:42.580894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:30:42.580894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:30:42.580894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:30:42.580894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:30:42.580894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 972976f8-9e27-41f2-b2d2-45fe7f8dae42 could not be found. (HTTP 404) (Request-ID: req-31eec785-cde9-4dce-b5a3-69e5191194da) Jul 14 14:30:42.580894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:42.580894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:42.580894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:42.581733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:42.581733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 14:30:42.581733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 14:30:42.581733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:30:42.581733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:30:42.581733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:30:42.581733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:30:42.581733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:30:42.581733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:30:42.581733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:30:42.581733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:30:42.581733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 14:30:42.581733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 14:30:42.581733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 14:30:42.581733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 14:30:42.581733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 14:30:42.581733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 14:30:42.581733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 14:30:42.581733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 14:30:42.582690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:30:42.582690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:30:42.582690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:30:42.582690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:30:42.582690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 972976f8-9e27-41f2-b2d2-45fe7f8dae42 could not be found. Jul 14 14:30:42.582690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:42.582690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:42.582690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:42.582690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:42.582690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:42.582690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:42.582690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:42.582690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:42.582690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:30:42.582690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:30:42.582690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:42.582690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:42.582690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 14:30:42.582690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:30:42.583610 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 972976f8-9e27-41f2-b2d2-45fe7f8dae42 could not be found. Jul 14 14:30:42.583610 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:42.583610 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:42.583610 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:42.583610 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:42.583610 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:42.583610 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:42.583610 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:30:42.583610 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:30:42.583610 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 972976f8-9e27-41f2-b2d2-45fe7f8dae42 could not be found. Jul 14 14:30:42.583610 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:42.583610 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0b5b569e-6bfd-4158-9770-aa80ed77cce1 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] Returning 404 to user: Volume 972976f8-9e27-41f2-b2d2-45fe7f8dae42 could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:42.583610 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-0b5b569e-6bfd-4158-9770-aa80ed77cce1 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/972976f8-9e27-41f2-b2d2-45fe7f8dae42" status: 404 len: 109 microversion: 2.1 time: 0.494645 Jul 14 14:30:42.583610 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 8/11] 10.222.0.93 () {58 vars in 1247 bytes} [Thu Jul 14 14:30:42 2022] DELETE /compute/v2.1/os-volumes/972976f8-9e27-41f2-b2d2-45fe7f8dae42 => generated 109 bytes in 496 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:30:42.591363 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a57b5df9-b633-471c-a133-272b39df4331 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] Calling method '.version_select at 0x7f416db5cdc0>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:42.694503 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-a57b5df9-b633-471c-a133-272b39df4331 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] HTTP exception thrown: Volume abbef620-9597-4d9e-821d-adea9b928dfd could not be found. Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a57b5df9-b633-471c-a133-272b39df4331 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] Request method failure captured: Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/os-volumes/abbef620-9597-4d9e-821d-adea9b928dfd HTTP/1.1 Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0CiLmv4rR3ON79UB10Tgqdvu4OKIGrk7n9PwzPQrtHPrqpfZxpsyVck4g6BTXeOKCry6mZj3F1maxIYGRJke-UZj9xN0GHQm5xB9TkF4W9EgAzq0MpCjkqA8JgOIvu7PdbXJ2gxEM3Ly_xXCxoJc__O2rekR9dImKDTJcj_LaR3MPZM Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: 00aaa9fa0a0949188f8a80bf052d8105 Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-VolumesNegativeTest-950114477 Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:30:42.701836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:30:42.703048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/00aaa9fa0a0949188f8a80bf052d8105"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:30:42.703048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-VolumesNegativeTest-950114477 Jul 14 14:30:42.703048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: 00aaa9fa0a0949188f8a80bf052d8105 Jul 14 14:30:42.703048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-VolumesNegativeTest-950114477 Jul 14 14:30:42.703048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-VolumesNegativeTest-950114477-project Jul 14 14:30:42.703048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:30:42.703048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:30:42.703048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 097d2584618a4292ac559e83a321669b Jul 14 14:30:42.703048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-VolumesNegativeTest-950114477-project Jul 14 14:30:42.703048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: Jul 14 14:30:42.703048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Volume abbef620-9597-4d9e-821d-adea9b928dfd could not be found. Jul 14 14:30:42.703048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': 'abbef620-9597-4d9e-821d-adea9b928dfd'} Jul 14 14:30:42.703048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:42.703808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:42.703808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:30:42.703808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:30:42.703808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:30:42.703808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:30:42.703808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:30:42.703808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:30:42.703808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:30:42.703808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:30:42.703808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:30:42.703808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:30:42.703808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:30:42.703808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:30:42.703808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:30:42.703808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:30:42.703808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume abbef620-9597-4d9e-821d-adea9b928dfd could not be found. (HTTP 404) (Request-ID: req-7af3b544-686d-4c65-8a7f-9e0007c573a1) Jul 14 14:30:42.703808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:30:42.703808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:42.703808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:30:42.704837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:42.704837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 14:30:42.704837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 14:30:42.704837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:30:42.704837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:30:42.704837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:30:42.704837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:30:42.704837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:30:42.704837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:30:42.704837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:30:42.704837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:30:42.704837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:30:42.704837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:30:42.704837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:30:42.704837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:30:42.704837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:30:42.704837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:30:42.704837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:30:42.704837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:30:42.706012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:30:42.706012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:30:42.706012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:30:42.706012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:30:42.706012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume abbef620-9597-4d9e-821d-adea9b928dfd could not be found. Jul 14 14:30:42.706012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:30:42.706012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:42.706012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:30:42.706012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:42.706012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:42.706012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:42.706012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:42.706012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:42.706012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:30:42.706012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:30:42.706012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:42.706012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:42.706012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 14:30:42.706012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:30:42.707085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume abbef620-9597-4d9e-821d-adea9b928dfd could not be found. Jul 14 14:30:42.707085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:30:42.707085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:42.707085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:30:42.707085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:42.707085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:42.707085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:42.707085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:30:42.707085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:30:42.707085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume abbef620-9597-4d9e-821d-adea9b928dfd could not be found. Jul 14 14:30:42.707085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:30:42.707085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a57b5df9-b633-471c-a133-272b39df4331 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] Returning 404 to user: Volume abbef620-9597-4d9e-821d-adea9b928dfd could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:42.707844 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a57b5df9-b633-471c-a133-272b39df4331 tempest-VolumesNegativeTest-950114477 tempest-VolumesNegativeTest-950114477-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/abbef620-9597-4d9e-821d-adea9b928dfd" status: 404 len: 109 microversion: 2.1 time: 0.120444 Jul 14 14:30:42.732554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 4/12] 10.222.0.93 () {58 vars in 1244 bytes} [Thu Jul 14 14:30:42 2022] GET /compute/v2.1/os-volumes/abbef620-9597-4d9e-821d-adea9b928dfd => generated 109 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:30:43.092352 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-dcbdef71-c8f4-405c-85e8-c67fb40dcea8 tempest-VolumesGetTestJSON-1873191104 tempest-VolumesGetTestJSON-1873191104-project] Calling method '.version_select at 0x7f416dada5e0>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:43.143649 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a6b5741d-925b-4f3c-a5dc-d1e4e249b863 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416e4f50d0>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:43.200730 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-dcbdef71-c8f4-405c-85e8-c67fb40dcea8 tempest-VolumesGetTestJSON-1873191104 tempest-VolumesGetTestJSON-1873191104-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/aab846f3-c358-4583-8732-0dc5eac6b2e1" status: 200 len: 353 microversion: 2.1 time: 0.112716 Jul 14 14:30:43.201329 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 9/13] 10.222.0.93 () {58 vars in 1244 bytes} [Thu Jul 14 14:30:43 2022] GET /compute/v2.1/os-volumes/aab846f3-c358-4583-8732-0dc5eac6b2e1 => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:43.226228 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-79625475-2fc4-4c48-b834-64d9d7b856ed tempest-VolumesGetTestJSON-1873191104 tempest-VolumesGetTestJSON-1873191104-project] Calling method '.version_select at 0x7f416daffe50>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:43.324127 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-79625475-2fc4-4c48-b834-64d9d7b856ed tempest-VolumesGetTestJSON-1873191104 tempest-VolumesGetTestJSON-1873191104-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/aab846f3-c358-4583-8732-0dc5eac6b2e1" status: 200 len: 353 microversion: 2.1 time: 0.113259 Jul 14 14:30:43.336851 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 10/14] 10.222.0.93 () {58 vars in 1244 bytes} [Thu Jul 14 14:30:43 2022] GET /compute/v2.1/os-volumes/aab846f3-c358-4583-8732-0dc5eac6b2e1 => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:43.343197 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-13b8ea6e-2e5b-47b1-8398-9e1110536605 tempest-VolumesGetTestJSON-1873191104 tempest-VolumesGetTestJSON-1873191104-project] Calling method '.version_select at 0x7f416daff280>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:43.398603 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a6b5741d-925b-4f3c-a5dc-d1e4e249b863 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549" status: 200 len: 346 microversion: 2.1 time: 0.259171 Jul 14 14:30:43.399429 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 5/15] 10.222.0.93 () {58 vars in 1244 bytes} [Thu Jul 14 14:30:43 2022] GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549 => generated 346 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:43.414094 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-41a44ee8-6b26-436a-80b1-ef7acafa4e6b tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Action: 'create', calling method: .version_select at 0x7f416dac7310>, body: {"snapshot": {"volume_id": "45a6f3c2-5987-413a-b432-c5143a80f549", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1904982168"}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:43.579267 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-13b8ea6e-2e5b-47b1-8398-9e1110536605 tempest-VolumesGetTestJSON-1873191104 tempest-VolumesGetTestJSON-1873191104-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/aab846f3-c358-4583-8732-0dc5eac6b2e1" status: 202 len: 0 microversion: 2.1 time: 0.239376 Jul 14 14:30:43.579787 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 11/16] 10.222.0.93 () {58 vars in 1247 bytes} [Thu Jul 14 14:30:43 2022] DELETE /compute/v2.1/os-volumes/aab846f3-c358-4583-8732-0dc5eac6b2e1 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:30:43.589262 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b5a1c2df-6b3f-4029-9d54-b19b23bc8d05 tempest-VolumesGetTestJSON-1873191104 tempest-VolumesGetTestJSON-1873191104-project] Calling method '.version_select at 0x7f416da8a160>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:43.680230 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b5a1c2df-6b3f-4029-9d54-b19b23bc8d05 tempest-VolumesGetTestJSON-1873191104 tempest-VolumesGetTestJSON-1873191104-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/aab846f3-c358-4583-8732-0dc5eac6b2e1" status: 200 len: 352 microversion: 2.1 time: 0.096040 Jul 14 14:30:43.687407 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 12/17] 10.222.0.93 () {58 vars in 1244 bytes} [Thu Jul 14 14:30:43 2022] GET /compute/v2.1/os-volumes/aab846f3-c358-4583-8732-0dc5eac6b2e1 => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:30:44.109936 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-41a44ee8-6b26-436a-80b1-ef7acafa4e6b tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.699643 Jul 14 14:30:44.115568 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 6/18] 10.222.0.93 () {60 vars in 1161 bytes} [Thu Jul 14 14:30:43 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:44.132232 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4dddc2d2-30e7-46f8-a76a-1664e2514ce2 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416daff700>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:44.264720 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4dddc2d2-30e7-46f8-a76a-1664e2514ce2 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35" status: 200 len: 287 microversion: 2.1 time: 0.146926 Jul 14 14:30:44.265577 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 13/19] 10.222.0.93 () {58 vars in 1250 bytes} [Thu Jul 14 14:30:44 2022] GET /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35 => generated 287 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:30:44.276424 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d51e4af4-b36c-496c-b7d6-58affcd3d2e7 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416dac7f70>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:44.699497 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b553b2b3-6566-4f01-bcd2-61e6c70841af tempest-VolumesGetTestJSON-1873191104 tempest-VolumesGetTestJSON-1873191104-project] Calling method '.version_select at 0x7f416daffca0>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:44.848836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-d51e4af4-b36c-496c-b7d6-58affcd3d2e7 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.576537 Jul 14 14:30:44.849406 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 7/20] 10.222.0.93 () {58 vars in 1139 bytes} [Thu Jul 14 14:30:44 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:44.862183 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-00d75654-ea36-460c-9be2-f28f0f6d76ac tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416db78ca0>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:44.881809 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-b553b2b3-6566-4f01-bcd2-61e6c70841af tempest-VolumesGetTestJSON-1873191104 tempest-VolumesGetTestJSON-1873191104-project] HTTP exception thrown: Volume aab846f3-c358-4583-8732-0dc5eac6b2e1 could not be found. Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b553b2b3-6566-4f01-bcd2-61e6c70841af tempest-VolumesGetTestJSON-1873191104 tempest-VolumesGetTestJSON-1873191104-project] Request method failure captured: Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: GET /compute/v2.1/os-volumes/aab846f3-c358-4583-8732-0dc5eac6b2e1 HTTP/1.1 Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0CiO4mvHKGGia5qKtm76BoP3hRaW-jAr2AYbxm8MuGUNYScqoxbFggwrSEMIVG8lROgYdrO2mXf7duCyhXNAJmbikmzsJIAdlpmp6_1jLuvxZ959Ud7DuuDwcw9TMDjN55CuMIJqalxYgAtz-zhK8en5d7x5NqYdhT0j5r4eZ1K4hzw Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: beb09664df9647519b7a1ed5a30b3858 Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-VolumesGetTestJSON-1873191104 Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:30:44.883952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:30:44.884961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_beb09664df9647519b7a1ed5a30b3858"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/beb09664df9647519b7a1ed5a30b3858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/beb09664df9647519b7a1ed5a30b3858"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/beb09664df9647519b7a1ed5a30b3858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:30:44.884961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-VolumesGetTestJSON-1873191104 Jul 14 14:30:44.884961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: beb09664df9647519b7a1ed5a30b3858 Jul 14 14:30:44.884961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-VolumesGetTestJSON-1873191104 Jul 14 14:30:44.884961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-VolumesGetTestJSON-1873191104-project Jul 14 14:30:44.884961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:30:44.884961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:30:44.884961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: 4b08d1bedbc946868c9f9bc0b3808591 Jul 14 14:30:44.884961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-VolumesGetTestJSON-1873191104-project Jul 14 14:30:44.884961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: Jul 14 14:30:44.884961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Volume aab846f3-c358-4583-8732-0dc5eac6b2e1 could not be found. Jul 14 14:30:44.884961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': 'aab846f3-c358-4583-8732-0dc5eac6b2e1'} Jul 14 14:30:44.884961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:44.885708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:44.885708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:30:44.885708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:30:44.885708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:30:44.885708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:30:44.885708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:30:44.885708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:30:44.885708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:30:44.885708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:30:44.885708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:30:44.885708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:30:44.885708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:30:44.885708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:30:44.885708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:30:44.885708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:30:44.885708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aab846f3-c358-4583-8732-0dc5eac6b2e1 could not be found. (HTTP 404) (Request-ID: req-574097e6-8ca4-4cf4-87e7-3e5e799a3a55) Jul 14 14:30:44.885708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:44.885708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:44.885708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:44.886611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:44.886611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 14:30:44.886611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 14:30:44.886611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:30:44.886611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:30:44.886611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:30:44.886611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:30:44.886611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:30:44.886611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:30:44.886611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:30:44.886611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:30:44.886611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:30:44.886611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:30:44.886611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:30:44.886611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:30:44.886611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:30:44.886611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:30:44.886611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:30:44.886611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:30:44.887644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:30:44.887644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:30:44.887644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:30:44.887644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:30:44.887644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aab846f3-c358-4583-8732-0dc5eac6b2e1 could not be found. Jul 14 14:30:44.887644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:44.887644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:44.887644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:44.887644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:44.887644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:44.887644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:44.887644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:44.887644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:44.887644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:30:44.887644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:30:44.887644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:44.887644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:44.887644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 14:30:44.887644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:30:44.888541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aab846f3-c358-4583-8732-0dc5eac6b2e1 could not be found. Jul 14 14:30:44.888541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:44.888541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:44.888541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:44.888541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:44.888541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:44.888541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:44.888541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:30:44.888541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:30:44.888541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aab846f3-c358-4583-8732-0dc5eac6b2e1 could not be found. Jul 14 14:30:44.888541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:30:44.891118 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b553b2b3-6566-4f01-bcd2-61e6c70841af tempest-VolumesGetTestJSON-1873191104 tempest-VolumesGetTestJSON-1873191104-project] Returning 404 to user: Volume aab846f3-c358-4583-8732-0dc5eac6b2e1 could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:44.892645 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b553b2b3-6566-4f01-bcd2-61e6c70841af tempest-VolumesGetTestJSON-1873191104 tempest-VolumesGetTestJSON-1873191104-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/aab846f3-c358-4583-8732-0dc5eac6b2e1" status: 404 len: 109 microversion: 2.1 time: 0.197343 Jul 14 14:30:44.893908 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 14/21] 10.222.0.93 () {58 vars in 1244 bytes} [Thu Jul 14 14:30:44 2022] GET /compute/v2.1/os-volumes/aab846f3-c358-4583-8732-0dc5eac6b2e1 => generated 109 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:30:44.955630 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-00d75654-ea36-460c-9be2-f28f0f6d76ac tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35" status: 200 len: 287 microversion: 2.1 time: 0.097290 Jul 14 14:30:44.960346 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 8/22] 10.222.0.93 () {58 vars in 1250 bytes} [Thu Jul 14 14:30:44 2022] GET /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35 => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:45.984789 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-cb89a1fe-4333-4341-9232-eb8748e6d816 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416daffb80>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:46.056531 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-cb89a1fe-4333-4341-9232-eb8748e6d816 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35" status: 200 len: 287 microversion: 2.1 time: 0.089104 Jul 14 14:30:46.057411 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 15/23] 10.222.0.93 () {58 vars in 1250 bytes} [Thu Jul 14 14:30:45 2022] GET /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35 => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:47.068717 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-317f69f1-72f0-40eb-abc7-f85ea1263cda tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416db78670>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:47.134473 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-317f69f1-72f0-40eb-abc7-f85ea1263cda tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35" status: 200 len: 287 microversion: 2.1 time: 0.069918 Jul 14 14:30:47.154862 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 9/24] 10.222.0.93 () {58 vars in 1250 bytes} [Thu Jul 14 14:30:47 2022] GET /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:48.165089 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-86ace233-4a7e-4b93-9760-33d78d0842c6 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416daff550>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:48.276490 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-86ace233-4a7e-4b93-9760-33d78d0842c6 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35" status: 200 len: 288 microversion: 2.1 time: 0.115413 Jul 14 14:30:48.279636 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 16/25] 10.222.0.93 () {58 vars in 1250 bytes} [Thu Jul 14 14:30:48 2022] GET /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35 => generated 288 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:48.305186 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-2e9415c2-6867-45a8-b036-52144adb3c0e tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416db78040>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:48.576112 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-2e9415c2-6867-45a8-b036-52144adb3c0e tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "DELETE /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35" status: 202 len: 0 microversion: 2.1 time: 0.286948 Jul 14 14:30:48.579443 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 10/26] 10.222.0.93 () {58 vars in 1253 bytes} [Thu Jul 14 14:30:48 2022] DELETE /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:30:48.588079 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f183ed27-9a0e-44cb-bd0b-bda0f2307b3a tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416dada940>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:48.642514 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-f183ed27-9a0e-44cb-bd0b-bda0f2307b3a tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35" status: 200 len: 287 microversion: 2.1 time: 0.059604 Jul 14 14:30:48.643749 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 17/27] 10.222.0.93 () {58 vars in 1250 bytes} [Thu Jul 14 14:30:48 2022] GET /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:49.653888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c6301ba2-30dd-4f9b-8b72-9de629191f97 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416dac7af0>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:49.734448 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c6301ba2-30dd-4f9b-8b72-9de629191f97 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35" status: 200 len: 287 microversion: 2.1 time: 0.084367 Jul 14 14:30:49.735308 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 11/28] 10.222.0.93 () {58 vars in 1250 bytes} [Thu Jul 14 14:30:49 2022] GET /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:30:50.771948 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-3cecc898-b780-4fd9-96e4-1c21befd5f95 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416dadac10>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:50.871502 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-3cecc898-b780-4fd9-96e4-1c21befd5f95 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35" status: 200 len: 287 microversion: 2.1 time: 0.128803 Jul 14 14:30:50.875887 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 18/29] 10.222.0.93 () {58 vars in 1250 bytes} [Thu Jul 14 14:30:50 2022] GET /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35 => generated 287 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:51.008926 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-64c55f1c-9105-46e9-9c3a-87bd45875e39 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2120934394", "imageRef": "7ea875a4-facb-4053-be2d-ff0080d2f3a0", "flavorRef": "452", "networks": [{"uuid": "31bdf79e-f084-4168-9b3d-9dd7c6b07ead"}]}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:51.220132 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.network.neutron [None req-64c55f1c-9105-46e9-9c3a-87bd45875e39 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] validate_networks() for [('31bdf79e-f084-4168-9b3d-9dd7c6b07ead', None, None, None, None, None)] {{(pid=118462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:30:51.538800 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-2d7d509b-8663-4126-abc1-df57123d599b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-916329597", "imageRef": "7ea875a4-facb-4053-be2d-ff0080d2f3a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:51.708462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.network.neutron [None req-2d7d509b-8663-4126-abc1-df57123d599b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] validate_networks() for [('d8b5e31c-98ed-487e-830d-724f1cd2a8c8', None, None, None, None, None)] {{(pid=118461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:30:52.968869 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-64c55f1c-9105-46e9-9c3a-87bd45875e39 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Flavor limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:30:52.971745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-64c55f1c-9105-46e9-9c3a-87bd45875e39 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Image limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:30:52.971745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-64c55f1c-9105-46e9-9c3a-87bd45875e39 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Flavor pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:30:52.971745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-64c55f1c-9105-46e9-9c3a-87bd45875e39 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Image pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:30:52.971745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-64c55f1c-9105-46e9-9c3a-87bd45875e39 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:30:53.017623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-64c55f1c-9105-46e9-9c3a-87bd45875e39 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:53.023390 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-64c55f1c-9105-46e9-9c3a-87bd45875e39 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:53.023390 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-64c55f1c-9105-46e9-9c3a-87bd45875e39 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:53.023390 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-64c55f1c-9105-46e9-9c3a-87bd45875e39 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:53.076157 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-64c55f1c-9105-46e9-9c3a-87bd45875e39 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Getting quotas for project 8725a19566454345b77b639cfe170008. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:30:53.091300 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-64c55f1c-9105-46e9-9c3a-87bd45875e39 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Getting quotas for user e2ac3e31fee448d7ae7a6d885f545636 and project 8725a19566454345b77b639cfe170008. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:30:53.112292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-64c55f1c-9105-46e9-9c3a-87bd45875e39 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Going to run 1 instances... {{(pid=118462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:30:53.115811 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-64c55f1c-9105-46e9-9c3a-87bd45875e39 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ea875a4-facb-4053-be2d-ff0080d2f3a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:30:53.262929 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-2d7d509b-8663-4126-abc1-df57123d599b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Flavor limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:30:53.263425 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-2d7d509b-8663-4126-abc1-df57123d599b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Image limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:30:53.263801 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-2d7d509b-8663-4126-abc1-df57123d599b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Flavor pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:30:53.264303 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-2d7d509b-8663-4126-abc1-df57123d599b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Image pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:30:53.264576 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-2d7d509b-8663-4126-abc1-df57123d599b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:30:53.283431 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2d7d509b-8663-4126-abc1-df57123d599b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:53.284012 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2d7d509b-8663-4126-abc1-df57123d599b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:53.284805 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2d7d509b-8663-4126-abc1-df57123d599b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:53.285301 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2d7d509b-8663-4126-abc1-df57123d599b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:53.364626 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-2d7d509b-8663-4126-abc1-df57123d599b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Getting quotas for project e2578b0e75cb455c93cf83dfe54842ff. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:30:53.373352 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-2d7d509b-8663-4126-abc1-df57123d599b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Getting quotas for user be6cba32a31a425e964d7222c3d6b9fc and project e2578b0e75cb455c93cf83dfe54842ff. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:30:53.400341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-2d7d509b-8663-4126-abc1-df57123d599b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Going to run 1 instances... {{(pid=118461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:30:53.404376 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-2d7d509b-8663-4126-abc1-df57123d599b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ea875a4-facb-4053-be2d-ff0080d2f3a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:30:53.534193 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-64c55f1c-9105-46e9-9c3a-87bd45875e39 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.782003 Jul 14 14:30:53.535293 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 12/30] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:30:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:30:53.547072 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-03c44e26-35f7-437c-ae6a-3efcefff2145 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416d1dd790>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:53.613754 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-03c44e26-35f7-437c-ae6a-3efcefff2145 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] HTTP exception thrown: Snapshot a3f10db4-ef8c-4f04-8527-3b9a0bb33a35 could not be found. Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-03c44e26-35f7-437c-ae6a-3efcefff2145 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Request method failure captured: Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35 HTTP/1.1 Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0CiNmIwIf0VAEbav4BTCp8QkoE5-mKNSSniB7zTERe8wbszO5I9QVMBQwfC8u4_pdJzGXuiBXwo2KFsfV504Iy07CjUrXdUr2RHwRBYjZqvgZQbwRRpUXMN1f4URo5MJZHbSXHw6uvTWo6kh-PBsFsEdlQ31BfjW3MSinA1rL9uWXfQ Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: a344d7e2cadb46129ede551661428bc7 Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1520776854 Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:30:53.620946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:30:53.622156 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a344d7e2cadb46129ede551661428bc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a344d7e2cadb46129ede551661428bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a344d7e2cadb46129ede551661428bc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a344d7e2cadb46129ede551661428bc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:30:53.622156 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1520776854 Jul 14 14:30:53.622156 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: a344d7e2cadb46129ede551661428bc7 Jul 14 14:30:53.622156 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1520776854 Jul 14 14:30:53.622156 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-VolumesSnapshotsTestJSON-1520776854-project Jul 14 14:30:53.622156 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:30:53.622156 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:30:53.622156 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: b209aeb321f64346a6d85d6ebebdd637 Jul 14 14:30:53.622156 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1520776854-project Jul 14 14:30:53.622156 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: Jul 14 14:30:53.622156 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Snapshot a3f10db4-ef8c-4f04-8527-3b9a0bb33a35 could not be found. Jul 14 14:30:53.622156 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': 'a3f10db4-ef8c-4f04-8527-3b9a0bb33a35'} Jul 14 14:30:53.622156 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:30:53.622838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:53.622838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 14:30:53.622838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 14:30:53.622838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 14:30:53.622838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 14:30:53.622838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 14:30:53.622838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 14:30:53.622838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:30:53.622838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:30:53.622838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:30:53.622838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:30:53.622838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:30:53.622838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:30:53.622838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:30:53.622838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:30:53.622838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a3f10db4-ef8c-4f04-8527-3b9a0bb33a35 could not be found. (HTTP 404) (Request-ID: req-8f80ec38-8300-4daa-94b1-98ca0cd1946d) Jul 14 14:30:53.622838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:30:53.622838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:53.623791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:30:53.623791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:53.623791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 14 14:30:53.623791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 14 14:30:53.623791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:30:53.623791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:30:53.623791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 14 14:30:53.623791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 14 14:30:53.623791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:30:53.623791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:30:53.623791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 14:30:53.623791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 14:30:53.623791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 14:30:53.623791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 14:30:53.623791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 14:30:53.623791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 14:30:53.623791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:30:53.623791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:30:53.623791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a3f10db4-ef8c-4f04-8527-3b9a0bb33a35 could not be found. Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 14 14:30:53.624814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:30:53.626003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a3f10db4-ef8c-4f04-8527-3b9a0bb33a35 could not be found. Jul 14 14:30:53.626003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:30:53.626003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:30:53.626003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:30:53.626003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:30:53.626003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:30:53.626003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:30:53.626003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:30:53.626003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:30:53.626003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a3f10db4-ef8c-4f04-8527-3b9a0bb33a35 could not be found. Jul 14 14:30:53.626003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:30:53.631663 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-03c44e26-35f7-437c-ae6a-3efcefff2145 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Returning 404 to user: Snapshot a3f10db4-ef8c-4f04-8527-3b9a0bb33a35 could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:30:53.632530 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-03c44e26-35f7-437c-ae6a-3efcefff2145 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "GET /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35" status: 404 len: 111 microversion: 2.1 time: 0.094107 Jul 14 14:30:53.633893 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 13/31] 10.222.0.93 () {58 vars in 1250 bytes} [Thu Jul 14 14:30:53 2022] GET /compute/v2.1/os-snapshots/a3f10db4-ef8c-4f04-8527-3b9a0bb33a35 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:30:53.644994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-1bdbc249-618e-4acc-b950-21c301147919 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:53.645876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-1bdbc249-618e-4acc-b950-21c301147919 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:53.780073 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-2d7d509b-8663-4126-abc1-df57123d599b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.444895 Jul 14 14:30:53.785988 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 19/32] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:30:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 2455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:30:53.812831 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-18e5198a-dffe-4c28-8e9e-8e3f091e12f6 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416d9efc10>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:54.035061 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-1bdbc249-618e-4acc-b950-21c301147919 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:54.130628 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-1bdbc249-618e-4acc-b950-21c301147919 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1215 microversion: 2.1 time: 0.480958 Jul 14 14:30:54.144126 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 14/33] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:53 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1215 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:54.162414 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-9b01991a-6594-49f7-89d4-363f13a7b095 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:54.164013 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-9b01991a-6594-49f7-89d4-363f13a7b095 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:54.258457 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-18e5198a-dffe-4c28-8e9e-8e3f091e12f6 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549" status: 202 len: 0 microversion: 2.1 time: 0.465288 Jul 14 14:30:54.261277 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 20/34] 10.222.0.93 () {58 vars in 1247 bytes} [Thu Jul 14 14:30:53 2022] DELETE /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:30:54.268294 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f6bba675-d861-4596-b047-f3d3ccad0256 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416c9883a0>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:54.323788 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-9b01991a-6594-49f7-89d4-363f13a7b095 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:54.340637 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-9b01991a-6594-49f7-89d4-363f13a7b095 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1221 microversion: 2.1 time: 0.195286 Jul 14 14:30:54.344752 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 15/35] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:54 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1221 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:54.467447 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-f6bba675-d861-4596-b047-f3d3ccad0256 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549" status: 200 len: 345 microversion: 2.1 time: 0.202906 Jul 14 14:30:54.472686 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 21/36] 10.222.0.93 () {58 vars in 1244 bytes} [Thu Jul 14 14:30:54 2022] GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549 => generated 345 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:54.627399 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a5217a52-b3e0-4de1-9447-90d8444ec67f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-44507357", "imageRef": "7ea875a4-facb-4053-be2d-ff0080d2f3a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:54.756326 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.network.neutron [None req-a5217a52-b3e0-4de1-9447-90d8444ec67f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] validate_networks() for [('d8b5e31c-98ed-487e-830d-724f1cd2a8c8', None, None, None, None, None)] {{(pid=118462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:30:55.148600 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-1406249f-da0e-4c44-b733-68a9b696d628 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:55.149556 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-1406249f-da0e-4c44-b733-68a9b696d628 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:55.475958 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-1406249f-da0e-4c44-b733-68a9b696d628 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:55.515233 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-1406249f-da0e-4c44-b733-68a9b696d628 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1215 microversion: 2.1 time: 0.370502 Jul 14 14:30:55.517060 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 22/37] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:55 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1215 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:30:55.805994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-a5217a52-b3e0-4de1-9447-90d8444ec67f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Flavor limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:30:55.806483 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-a5217a52-b3e0-4de1-9447-90d8444ec67f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Image limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:30:55.806977 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-a5217a52-b3e0-4de1-9447-90d8444ec67f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Flavor pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:30:55.807904 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-a5217a52-b3e0-4de1-9447-90d8444ec67f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Image pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:30:55.808321 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-a5217a52-b3e0-4de1-9447-90d8444ec67f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:30:55.837012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a5217a52-b3e0-4de1-9447-90d8444ec67f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:55.838881 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a5217a52-b3e0-4de1-9447-90d8444ec67f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:55.842411 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a5217a52-b3e0-4de1-9447-90d8444ec67f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:55.843042 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a5217a52-b3e0-4de1-9447-90d8444ec67f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:55.877906 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-a5217a52-b3e0-4de1-9447-90d8444ec67f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Getting quotas for project e2578b0e75cb455c93cf83dfe54842ff. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:30:55.883104 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-a5217a52-b3e0-4de1-9447-90d8444ec67f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Getting quotas for user be6cba32a31a425e964d7222c3d6b9fc and project e2578b0e75cb455c93cf83dfe54842ff. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:30:55.899468 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a5217a52-b3e0-4de1-9447-90d8444ec67f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Going to run 1 instances... {{(pid=118462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:30:55.902050 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a5217a52-b3e0-4de1-9447-90d8444ec67f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ea875a4-facb-4053-be2d-ff0080d2f3a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:30:55.975586 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ec8f49a4-c895-4763-aa2d-f766da6eb47b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Action: 'create', calling method: .version_select at 0x7f416c988ee0>, body: {"keypair": {"name": "tempest-keypair-1596622070", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAs53dTRkfuEQe0bQTGAk7qel1K34dZl+MgfYQunwyJLeTRszj7WMSQgjBh33b/av8OpmdDVtjLoCRzs+XC+bJlG/3hRPH8C4Pj2fB/vBoj5cK5VyZ3e2to3PuaaqF58iA=="}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:30:56.016711 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-ec8f49a4-c895-4763-aa2d-f766da6eb47b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Getting quotas for project 9f707e1171364031b016d16a10efda78. Resources: {'key_pairs'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:30:56.024463 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-ec8f49a4-c895-4763-aa2d-f766da6eb47b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Getting quotas for user bc26c3a3096b4b318d18d4c919f7a60a and project 9f707e1171364031b016d16a10efda78. Resources: {'key_pairs'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:30:56.102434 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a5217a52-b3e0-4de1-9447-90d8444ec67f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.474771 Jul 14 14:30:56.102434 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 16/38] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:30:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 1476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:30:56.110882 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-2e142de2-26d5-4e0d-99d9-ffd9858fb549 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416c9a7af0>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:56.231897 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-2e142de2-26d5-4e0d-99d9-ffd9858fb549 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549" status: 200 len: 345 microversion: 2.1 time: 0.129995 Jul 14 14:30:56.232924 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 17/39] 10.222.0.93 () {58 vars in 1244 bytes} [Thu Jul 14 14:30:56 2022] GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549 => generated 345 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:56.237884 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-80575b82-181d-43fd-9273-9792b2632a66 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:56.238500 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-80575b82-181d-43fd-9273-9792b2632a66 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:56.244933 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-ec8f49a4-c895-4763-aa2d-f766da6eb47b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.723823 Jul 14 14:30:56.246000 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 23/40] 10.222.0.93 () {60 vars in 1158 bytes} [Thu Jul 14 14:30:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:56.466194 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-80575b82-181d-43fd-9273-9792b2632a66 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:56.483808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-80575b82-181d-43fd-9273-9792b2632a66 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1220 microversion: 2.1 time: 0.249763 Jul 14 14:30:56.495920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 18/41] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:56 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1220 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:56.536842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-318eba83-4a1d-4e97-b9fd-e8ac6507e1ef tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:56.538016 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-318eba83-4a1d-4e97-b9fd-e8ac6507e1ef tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:56.625413 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-318eba83-4a1d-4e97-b9fd-e8ac6507e1ef tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:56.636085 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-318eba83-4a1d-4e97-b9fd-e8ac6507e1ef tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1215 microversion: 2.1 time: 0.107695 Jul 14 14:30:56.636890 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 24/42] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:56 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:57.244760 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-eef92fc2-78b9-4aea-85b3-ead7fa83307b tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416c9a7940>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:57.368324 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-eef92fc2-78b9-4aea-85b3-ead7fa83307b tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549" status: 200 len: 345 microversion: 2.1 time: 0.127402 Jul 14 14:30:57.379287 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 19/43] 10.222.0.93 () {58 vars in 1244 bytes} [Thu Jul 14 14:30:57 2022] GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549 => generated 345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:57.513367 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a8dd2272-abfa-4a00-ad27-228e89278bc6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:57.522338 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a8dd2272-abfa-4a00-ad27-228e89278bc6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:57.654551 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a8dd2272-abfa-4a00-ad27-228e89278bc6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:57.655265 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ef2329e4-ac6d-4048-b902-1c7b93d594b9 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:57.655364 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ef2329e4-ac6d-4048-b902-1c7b93d594b9 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:57.662948 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a8dd2272-abfa-4a00-ad27-228e89278bc6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1220 microversion: 2.1 time: 0.154304 Jul 14 14:30:57.666082 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 25/44] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:57 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1220 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:57.668473 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ef2329e4-ac6d-4048-b902-1c7b93d594b9 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:57.669112 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ef2329e4-ac6d-4048-b902-1c7b93d594b9 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:57.670149 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ef2329e4-ac6d-4048-b902-1c7b93d594b9 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:57.670580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ef2329e4-ac6d-4048-b902-1c7b93d594b9 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:57.936981 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ef2329e4-ac6d-4048-b902-1c7b93d594b9 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:57.949522 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ef2329e4-ac6d-4048-b902-1c7b93d594b9 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1219 microversion: 2.1 time: 0.300437 Jul 14 14:30:57.951561 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 20/45] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:57 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1219 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:58.394896 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-21bc580d-23b6-49d8-8c76-150289b25de6 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416c14a8b0>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:58.485857 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-21bc580d-23b6-49d8-8c76-150289b25de6 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549" status: 200 len: 345 microversion: 2.1 time: 0.094911 Jul 14 14:30:58.486678 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 26/46] 10.222.0.93 () {58 vars in 1244 bytes} [Thu Jul 14 14:30:58 2022] GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549 => generated 345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:58.682832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a74ba342-7e28-4578-8fa4-03dee01872b8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:58.683493 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a74ba342-7e28-4578-8fa4-03dee01872b8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:58.689828 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a74ba342-7e28-4578-8fa4-03dee01872b8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:58.690260 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a74ba342-7e28-4578-8fa4-03dee01872b8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:58.691057 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a74ba342-7e28-4578-8fa4-03dee01872b8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:58.691491 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a74ba342-7e28-4578-8fa4-03dee01872b8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:58.813288 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a74ba342-7e28-4578-8fa4-03dee01872b8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:58.827705 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a74ba342-7e28-4578-8fa4-03dee01872b8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1224 microversion: 2.1 time: 0.146655 Jul 14 14:30:58.827705 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 21/47] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:58 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1224 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:58.970953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b0feed74-b666-4df9-a360-1e3b4366d944 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:58.971982 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b0feed74-b666-4df9-a360-1e3b4366d944 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:58.988713 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b0feed74-b666-4df9-a360-1e3b4366d944 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:58.989181 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b0feed74-b666-4df9-a360-1e3b4366d944 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:58.993142 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b0feed74-b666-4df9-a360-1e3b4366d944 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:58.993599 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b0feed74-b666-4df9-a360-1e3b4366d944 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:59.178916 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b0feed74-b666-4df9-a360-1e3b4366d944 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:30:59.203071 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b0feed74-b666-4df9-a360-1e3b4366d944 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1219 microversion: 2.1 time: 0.238449 Jul 14 14:30:59.214997 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 27/48] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:58 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1219 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:30:59.501495 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b44d3379-1337-4f57-bb05-711ce9b698ec tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416c91a550>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:59.602964 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b44d3379-1337-4f57-bb05-711ce9b698ec tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549" status: 200 len: 345 microversion: 2.1 time: 0.108337 Jul 14 14:30:59.604080 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 22/49] 10.222.0.93 () {58 vars in 1244 bytes} [Thu Jul 14 14:30:59 2022] GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549 => generated 345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:30:59.842427 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-cc15856d-86b4-43ec-8046-644ee71b4a5c tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:30:59.843035 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-cc15856d-86b4-43ec-8046-644ee71b4a5c tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:30:59.887389 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cc15856d-86b4-43ec-8046-644ee71b4a5c tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:59.890041 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cc15856d-86b4-43ec-8046-644ee71b4a5c tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:30:59.906888 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cc15856d-86b4-43ec-8046-644ee71b4a5c tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:30:59.909713 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cc15856d-86b4-43ec-8046-644ee71b4a5c tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:00.098041 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-cc15856d-86b4-43ec-8046-644ee71b4a5c tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:00.109715 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-cc15856d-86b4-43ec-8046-644ee71b4a5c tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1224 microversion: 2.1 time: 0.270879 Jul 14 14:31:00.111570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 28/50] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:30:59 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1224 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:00.222179 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-befd944a-8e08-48b2-b585-3f18dfec3868 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:00.222803 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-befd944a-8e08-48b2-b585-3f18dfec3868 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:00.237520 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-befd944a-8e08-48b2-b585-3f18dfec3868 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:00.238615 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-befd944a-8e08-48b2-b585-3f18dfec3868 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:00.241915 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-befd944a-8e08-48b2-b585-3f18dfec3868 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:00.242380 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-befd944a-8e08-48b2-b585-3f18dfec3868 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:00.617540 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b967e520-0609-4de2-ad5e-7d84facf7b31 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416c0cb5e0>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:00.630692 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-befd944a-8e08-48b2-b585-3f18dfec3868 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:00.638845 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-befd944a-8e08-48b2-b585-3f18dfec3868 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1219 microversion: 2.1 time: 0.421790 Jul 14 14:31:00.645089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 23/51] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:00 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1219 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:00.651997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c49bc61f-7412-4a7e-bfba-94216b79e7f8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1525194617", "imageRef": "7ea875a4-facb-4053-be2d-ff0080d2f3a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbfe63db-9252-4dec-a8a5-e4a436973249"}], "security_groups": [{"name": "tempest-securitygroup--753945864"}], "key_name": "tempest-keypair-1596622070", "user_data": "}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:00.874695 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-b967e520-0609-4de2-ad5e-7d84facf7b31 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] HTTP exception thrown: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b967e520-0609-4de2-ad5e-7d84facf7b31 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Request method failure captured: Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549 HTTP/1.1 Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0CiNmIwIf0VAEbav4BTCp8QkoE5-mKNSSniB7zTERe8wbszO5I9QVMBQwfC8u4_pdJzGXuiBXwo2KFsfV504Iy07CjUrXdUr2RHwRBYjZqvgZQbwRRpUXMN1f4URo5MJZHbSXHw6uvTWo6kh-PBsFsEdlQ31BfjW3MSinA1rL9uWXfQ Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: a344d7e2cadb46129ede551661428bc7 Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1520776854 Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:31:00.876942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:31:00.878300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a344d7e2cadb46129ede551661428bc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a344d7e2cadb46129ede551661428bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a344d7e2cadb46129ede551661428bc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a344d7e2cadb46129ede551661428bc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:31:00.878300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1520776854 Jul 14 14:31:00.878300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: a344d7e2cadb46129ede551661428bc7 Jul 14 14:31:00.878300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1520776854 Jul 14 14:31:00.878300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-VolumesSnapshotsTestJSON-1520776854-project Jul 14 14:31:00.878300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:31:00.878300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:31:00.878300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: b209aeb321f64346a6d85d6ebebdd637 Jul 14 14:31:00.878300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1520776854-project Jul 14 14:31:00.878300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: Jul 14 14:31:00.878300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. Jul 14 14:31:00.878300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': '45a6f3c2-5987-413a-b432-c5143a80f549'} Jul 14 14:31:00.878300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:00.879110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:00.879110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:31:00.879110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:31:00.879110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:31:00.879110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:31:00.879110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:31:00.879110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:31:00.879110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:31:00.879110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:31:00.879110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:31:00.879110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:31:00.879110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:31:00.879110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:31:00.879110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:31:00.879110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:31:00.879110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. (HTTP 404) (Request-ID: req-7785addf-0f76-4643-96e8-9d8295985936) Jul 14 14:31:00.879110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:00.879110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:00.879110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:00.880309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:00.880309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 14:31:00.880309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 14:31:00.880309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:31:00.880309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:31:00.880309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:31:00.880309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:31:00.880309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:31:00.880309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:31:00.880309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:31:00.880309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:31:00.880309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:31:00.880309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:31:00.880309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:31:00.880309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:31:00.880309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:31:00.880309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:31:00.880309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:31:00.880309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:31:00.881462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:31:00.881462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:31:00.881462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:31:00.881462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:31:00.881462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. Jul 14 14:31:00.881462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:00.881462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:00.881462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:00.881462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:00.881462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:00.881462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:00.881462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:00.881462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:00.881462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:31:00.881462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:31:00.881462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:00.881462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:00.881462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 14:31:00.881462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:31:00.882687 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. Jul 14 14:31:00.882687 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:00.882687 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:00.882687 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:00.882687 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:00.882687 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:00.882687 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:00.882687 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:31:00.882687 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:31:00.882687 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. Jul 14 14:31:00.882687 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:00.886216 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b967e520-0609-4de2-ad5e-7d84facf7b31 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Returning 404 to user: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:00.887429 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b967e520-0609-4de2-ad5e-7d84facf7b31 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549" status: 404 len: 109 microversion: 2.1 time: 0.274900 Jul 14 14:31:00.897561 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 29/52] 10.222.0.93 () {58 vars in 1244 bytes} [Thu Jul 14 14:31:00 2022] GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549 => generated 109 bytes in 285 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:31:00.903697 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f1454a72-f3e1-4771-9b94-1a7c4d1109d4 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416c14d8b0>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:00.936681 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-f1454a72-f3e1-4771-9b94-1a7c4d1109d4 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] HTTP exception thrown: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f1454a72-f3e1-4771-9b94-1a7c4d1109d4 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Request method failure captured: Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: DELETE /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549 HTTP/1.1 Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0CiNmIwIf0VAEbav4BTCp8QkoE5-mKNSSniB7zTERe8wbszO5I9QVMBQwfC8u4_pdJzGXuiBXwo2KFsfV504Iy07CjUrXdUr2RHwRBYjZqvgZQbwRRpUXMN1f4URo5MJZHbSXHw6uvTWo6kh-PBsFsEdlQ31BfjW3MSinA1rL9uWXfQ Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: a344d7e2cadb46129ede551661428bc7 Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1520776854 Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:31:00.939478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:31:00.940832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a344d7e2cadb46129ede551661428bc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a344d7e2cadb46129ede551661428bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a344d7e2cadb46129ede551661428bc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a344d7e2cadb46129ede551661428bc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:31:00.940832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1520776854 Jul 14 14:31:00.940832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: a344d7e2cadb46129ede551661428bc7 Jul 14 14:31:00.940832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1520776854 Jul 14 14:31:00.940832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-VolumesSnapshotsTestJSON-1520776854-project Jul 14 14:31:00.940832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:31:00.940832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:31:00.940832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: b209aeb321f64346a6d85d6ebebdd637 Jul 14 14:31:00.940832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1520776854-project Jul 14 14:31:00.940832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: Jul 14 14:31:00.940832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. Jul 14 14:31:00.940832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': '45a6f3c2-5987-413a-b432-c5143a80f549'} Jul 14 14:31:00.940832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:00.941912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:00.941912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:31:00.941912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:31:00.941912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 14:31:00.941912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 14:31:00.941912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 14:31:00.941912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 14:31:00.941912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 14:31:00.941912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 14:31:00.941912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 14:31:00.941912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 14:31:00.941912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:31:00.941912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:31:00.941912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:31:00.941912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:31:00.941912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. (HTTP 404) (Request-ID: req-8731a7ef-436e-4e5b-87cd-066ad3b21520) Jul 14 14:31:00.941912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:00.941912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:00.941912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:00.942876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:00.942876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 14:31:00.942876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 14:31:00.942876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:31:00.942876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:31:00.942876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:31:00.942876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:31:00.942876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:31:00.942876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:31:00.942876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:31:00.942876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:31:00.942876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 14:31:00.942876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 14:31:00.942876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 14:31:00.942876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 14:31:00.942876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 14:31:00.942876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 14:31:00.942876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 14:31:00.942876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 14:31:00.943793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:31:00.943793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:31:00.943793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:31:00.943793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:31:00.943793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. Jul 14 14:31:00.943793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:00.943793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:00.943793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:00.943793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:00.943793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:00.943793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:00.943793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:00.943793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:00.943793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:31:00.943793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:31:00.943793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:00.943793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:00.943793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 14:31:00.943793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:31:00.944803 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. Jul 14 14:31:00.944803 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:00.944803 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:00.944803 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:00.944803 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:00.944803 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:00.944803 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:00.944803 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:31:00.944803 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:31:00.944803 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. Jul 14 14:31:00.944803 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:00.947127 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f1454a72-f3e1-4771-9b94-1a7c4d1109d4 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Returning 404 to user: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:00.948830 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-f1454a72-f3e1-4771-9b94-1a7c4d1109d4 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "DELETE /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549" status: 404 len: 109 microversion: 2.1 time: 0.049705 Jul 14 14:31:00.949399 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 30/53] 10.222.0.93 () {58 vars in 1247 bytes} [Thu Jul 14 14:31:00 2022] DELETE /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:31:00.960149 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4e3b4184-0fdb-47e2-b18e-343cf5858730 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Calling method '.version_select at 0x7f416c14d430>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:00.995230 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-4e3b4184-0fdb-47e2-b18e-343cf5858730 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] HTTP exception thrown: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4e3b4184-0fdb-47e2-b18e-343cf5858730 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Request method failure captured: Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549 HTTP/1.1 Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0CiNmIwIf0VAEbav4BTCp8QkoE5-mKNSSniB7zTERe8wbszO5I9QVMBQwfC8u4_pdJzGXuiBXwo2KFsfV504Iy07CjUrXdUr2RHwRBYjZqvgZQbwRRpUXMN1f4URo5MJZHbSXHw6uvTWo6kh-PBsFsEdlQ31BfjW3MSinA1rL9uWXfQ Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: a344d7e2cadb46129ede551661428bc7 Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1520776854 Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:31:00.997596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:31:00.998723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_a344d7e2cadb46129ede551661428bc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a344d7e2cadb46129ede551661428bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/a344d7e2cadb46129ede551661428bc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/a344d7e2cadb46129ede551661428bc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:31:00.998723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1520776854 Jul 14 14:31:00.998723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: a344d7e2cadb46129ede551661428bc7 Jul 14 14:31:00.998723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1520776854 Jul 14 14:31:00.998723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-VolumesSnapshotsTestJSON-1520776854-project Jul 14 14:31:00.998723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:31:00.998723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:31:00.998723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: b209aeb321f64346a6d85d6ebebdd637 Jul 14 14:31:00.998723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1520776854-project Jul 14 14:31:00.998723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: Jul 14 14:31:00.998723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. Jul 14 14:31:00.998723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': '45a6f3c2-5987-413a-b432-c5143a80f549'} Jul 14 14:31:00.998723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:00.999388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:00.999388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:31:00.999388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:31:00.999388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:31:00.999388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:31:00.999388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:31:00.999388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:31:00.999388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:31:00.999388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:31:00.999388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:31:00.999388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:31:00.999388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:31:00.999388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:31:00.999388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:31:00.999388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:31:00.999388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. (HTTP 404) (Request-ID: req-029f268d-6191-49c8-8e37-ad4176cf937f) Jul 14 14:31:00.999388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:00.999388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:00.999388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:01.001033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:01.001033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 14:31:01.001033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 14:31:01.001033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:31:01.001033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:31:01.001033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:31:01.001033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:31:01.001033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:31:01.001033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:31:01.001033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:31:01.001033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:31:01.001033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:31:01.001033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:31:01.001033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:31:01.001033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:31:01.001033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:31:01.001033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:31:01.001033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:31:01.001033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:31:01.002207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:31:01.002207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:31:01.002207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:31:01.002207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:31:01.002207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. Jul 14 14:31:01.002207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:01.002207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:01.002207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:01.002207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:01.002207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:01.002207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:01.002207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:01.002207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:01.002207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:31:01.002207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:31:01.002207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:01.002207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:01.002207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 14:31:01.002207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:31:01.003922 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. Jul 14 14:31:01.003922 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:01.003922 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:01.003922 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:01.003922 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:01.003922 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:01.003922 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:01.003922 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:31:01.003922 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:31:01.003922 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. Jul 14 14:31:01.003922 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:01.003922 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4e3b4184-0fdb-47e2-b18e-343cf5858730 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] Returning 404 to user: Volume 45a6f3c2-5987-413a-b432-c5143a80f549 could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:01.003922 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4e3b4184-0fdb-47e2-b18e-343cf5858730 tempest-VolumesSnapshotsTestJSON-1520776854 tempest-VolumesSnapshotsTestJSON-1520776854-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549" status: 404 len: 109 microversion: 2.1 time: 0.045475 Jul 14 14:31:01.003922 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 31/54] 10.222.0.93 () {58 vars in 1244 bytes} [Thu Jul 14 14:31:00 2022] GET /compute/v2.1/os-volumes/45a6f3c2-5987-413a-b432-c5143a80f549 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:31:01.127618 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-18d9d490-39ab-42fb-b214-a1eb3a68c300 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:01.129104 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-18d9d490-39ab-42fb-b214-a1eb3a68c300 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:01.139545 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-18d9d490-39ab-42fb-b214-a1eb3a68c300 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:01.139545 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-18d9d490-39ab-42fb-b214-a1eb3a68c300 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:01.142221 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-18d9d490-39ab-42fb-b214-a1eb3a68c300 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:01.142958 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-18d9d490-39ab-42fb-b214-a1eb3a68c300 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:01.318445 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-18d9d490-39ab-42fb-b214-a1eb3a68c300 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:01.329762 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-18d9d490-39ab-42fb-b214-a1eb3a68c300 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1272 microversion: 2.1 time: 0.206747 Jul 14 14:31:01.330677 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 32/55] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:01 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:01.353001 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.network.neutron [None req-c49bc61f-7412-4a7e-bfba-94216b79e7f8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] validate_networks() for [('bbfe63db-9252-4dec-a8a5-e4a436973249', None, None, None, None, None)] {{(pid=118462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:31:01.662167 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-2cdaffec-0572-436c-b2b7-e54e01e95357 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:01.662832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-2cdaffec-0572-436c-b2b7-e54e01e95357 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:01.687099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2cdaffec-0572-436c-b2b7-e54e01e95357 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:01.688898 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2cdaffec-0572-436c-b2b7-e54e01e95357 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:01.691739 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2cdaffec-0572-436c-b2b7-e54e01e95357 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:01.692288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2cdaffec-0572-436c-b2b7-e54e01e95357 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:01.985008 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-2cdaffec-0572-436c-b2b7-e54e01e95357 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:01.993573 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-2cdaffec-0572-436c-b2b7-e54e01e95357 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1267 microversion: 2.1 time: 0.335579 Jul 14 14:31:02.005755 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 33/56] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:01 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1267 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:02.347265 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b48375a0-65ff-4328-9205-7b8dbe4268eb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:02.352347 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b48375a0-65ff-4328-9205-7b8dbe4268eb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:02.364880 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b48375a0-65ff-4328-9205-7b8dbe4268eb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:02.367088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b48375a0-65ff-4328-9205-7b8dbe4268eb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:02.368116 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b48375a0-65ff-4328-9205-7b8dbe4268eb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:02.371077 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b48375a0-65ff-4328-9205-7b8dbe4268eb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:02.728514 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b48375a0-65ff-4328-9205-7b8dbe4268eb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:02.773461 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b48375a0-65ff-4328-9205-7b8dbe4268eb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1280 microversion: 2.1 time: 0.429884 Jul 14 14:31:02.785119 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 34/57] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:02 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1280 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:02.819810 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-c49bc61f-7412-4a7e-bfba-94216b79e7f8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Flavor limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:31:02.820317 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-c49bc61f-7412-4a7e-bfba-94216b79e7f8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Image limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:31:02.821066 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-c49bc61f-7412-4a7e-bfba-94216b79e7f8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Flavor pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:31:02.822259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-c49bc61f-7412-4a7e-bfba-94216b79e7f8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Image pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:31:02.823643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-c49bc61f-7412-4a7e-bfba-94216b79e7f8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:31:02.857696 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c49bc61f-7412-4a7e-bfba-94216b79e7f8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:02.860385 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c49bc61f-7412-4a7e-bfba-94216b79e7f8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:02.861535 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c49bc61f-7412-4a7e-bfba-94216b79e7f8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:02.862108 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c49bc61f-7412-4a7e-bfba-94216b79e7f8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:02.883551 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-c49bc61f-7412-4a7e-bfba-94216b79e7f8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Getting quotas for project 9f707e1171364031b016d16a10efda78. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:31:02.888050 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-c49bc61f-7412-4a7e-bfba-94216b79e7f8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Getting quotas for user bc26c3a3096b4b318d18d4c919f7a60a and project 9f707e1171364031b016d16a10efda78. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:31:02.899359 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c49bc61f-7412-4a7e-bfba-94216b79e7f8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Going to run 1 instances... {{(pid=118462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:31:02.902263 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c49bc61f-7412-4a7e-bfba-94216b79e7f8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ea875a4-facb-4053-be2d-ff0080d2f3a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:31:03.011596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d3ecb941-5931-479a-b4dc-9a556932bddb tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:03.012209 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d3ecb941-5931-479a-b4dc-9a556932bddb tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:03.026479 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d3ecb941-5931-479a-b4dc-9a556932bddb tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:03.027108 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d3ecb941-5931-479a-b4dc-9a556932bddb tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:03.028190 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d3ecb941-5931-479a-b4dc-9a556932bddb tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:03.028836 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d3ecb941-5931-479a-b4dc-9a556932bddb tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:03.100708 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c49bc61f-7412-4a7e-bfba-94216b79e7f8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.454498 Jul 14 14:31:03.102037 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 24/58] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:31:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 2456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:31:03.114784 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-78c1b1c5-d602-424f-9962-2c04d050771f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:03.115871 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-78c1b1c5-d602-424f-9962-2c04d050771f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:03.272293 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d3ecb941-5931-479a-b4dc-9a556932bddb tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:03.283093 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d3ecb941-5931-479a-b4dc-9a556932bddb tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1273 microversion: 2.1 time: 0.275035 Jul 14 14:31:03.284061 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 35/59] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:03 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1273 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:03.317957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-78c1b1c5-d602-424f-9962-2c04d050771f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:03.326199 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-78c1b1c5-d602-424f-9962-2c04d050771f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1238 microversion: 2.1 time: 0.215330 Jul 14 14:31:03.326785 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 25/60] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:03 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1238 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:03.791154 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-faed2fc0-9159-40e5-9760-0b67d1a4410d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:03.791763 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-faed2fc0-9159-40e5-9760-0b67d1a4410d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:03.797286 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:03.799103 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-faed2fc0-9159-40e5-9760-0b67d1a4410d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:03.799548 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-faed2fc0-9159-40e5-9760-0b67d1a4410d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:03.800302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-faed2fc0-9159-40e5-9760-0b67d1a4410d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:03.800937 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-faed2fc0-9159-40e5-9760-0b67d1a4410d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:03.883099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-faed2fc0-9159-40e5-9760-0b67d1a4410d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:03.893681 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-faed2fc0-9159-40e5-9760-0b67d1a4410d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1278 microversion: 2.1 time: 0.106097 Jul 14 14:31:03.895036 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 36/61] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:03 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1278 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:04.308740 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-5708c043-0202-497e-a2e3-aca40705521f tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:04.309423 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-5708c043-0202-497e-a2e3-aca40705521f tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:04.324215 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5708c043-0202-497e-a2e3-aca40705521f tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:04.326730 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5708c043-0202-497e-a2e3-aca40705521f tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:04.332690 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5708c043-0202-497e-a2e3-aca40705521f tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:04.332690 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5708c043-0202-497e-a2e3-aca40705521f tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:04.346745 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-9846c0bd-bb88-4d45-beb6-62944c438c51 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:04.347725 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-9846c0bd-bb88-4d45-beb6-62944c438c51 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:04.473290 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-5708c043-0202-497e-a2e3-aca40705521f tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:04.493644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-5708c043-0202-497e-a2e3-aca40705521f tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1273 microversion: 2.1 time: 0.188210 Jul 14 14:31:04.502739 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 26/62] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:04 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1273 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:04.547337 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-9846c0bd-bb88-4d45-beb6-62944c438c51 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:04.567972 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-9846c0bd-bb88-4d45-beb6-62944c438c51 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1238 microversion: 2.1 time: 0.227822 Jul 14 14:31:04.579499 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 37/63] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:04 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1238 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:04.913116 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-6afe64c8-4b5e-4a90-a8a8-7d7177981b32 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:04.914603 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-6afe64c8-4b5e-4a90-a8a8-7d7177981b32 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:04.932988 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6afe64c8-4b5e-4a90-a8a8-7d7177981b32 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:04.933451 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6afe64c8-4b5e-4a90-a8a8-7d7177981b32 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:04.935409 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6afe64c8-4b5e-4a90-a8a8-7d7177981b32 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:04.935866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6afe64c8-4b5e-4a90-a8a8-7d7177981b32 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:05.089114 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-6afe64c8-4b5e-4a90-a8a8-7d7177981b32 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:05.098522 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-6afe64c8-4b5e-4a90-a8a8-7d7177981b32 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1278 microversion: 2.1 time: 0.191593 Jul 14 14:31:05.099179 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 27/64] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:04 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1278 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:05.513748 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c75e12d1-e179-4f1d-8b9b-b53fc361ee8c tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:05.515120 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c75e12d1-e179-4f1d-8b9b-b53fc361ee8c tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:05.535150 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c75e12d1-e179-4f1d-8b9b-b53fc361ee8c tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:05.535999 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c75e12d1-e179-4f1d-8b9b-b53fc361ee8c tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:05.537043 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c75e12d1-e179-4f1d-8b9b-b53fc361ee8c tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:05.537730 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c75e12d1-e179-4f1d-8b9b-b53fc361ee8c tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:05.597392 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-cd736d12-22e1-4f4b-a1d9-85dd656b26dd tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:05.598845 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-cd736d12-22e1-4f4b-a1d9-85dd656b26dd tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:05.605387 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cd736d12-22e1-4f4b-a1d9-85dd656b26dd tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:05.606021 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cd736d12-22e1-4f4b-a1d9-85dd656b26dd tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:05.607177 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cd736d12-22e1-4f4b-a1d9-85dd656b26dd tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:05.607712 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cd736d12-22e1-4f4b-a1d9-85dd656b26dd tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:05.875858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-cd736d12-22e1-4f4b-a1d9-85dd656b26dd tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:05.889738 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-cd736d12-22e1-4f4b-a1d9-85dd656b26dd tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1242 microversion: 2.1 time: 0.292742 Jul 14 14:31:05.893668 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 28/65] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:05 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1242 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:05.930182 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c75e12d1-e179-4f1d-8b9b-b53fc361ee8c tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:05.938505 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c75e12d1-e179-4f1d-8b9b-b53fc361ee8c tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.430191 Jul 14 14:31:05.943189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 38/66] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:05 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:06.116485 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-76f41b98-a5a2-47a5-933f-9e63cf4b3796 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:06.117100 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-76f41b98-a5a2-47a5-933f-9e63cf4b3796 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:06.127964 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-76f41b98-a5a2-47a5-933f-9e63cf4b3796 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:06.130486 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-76f41b98-a5a2-47a5-933f-9e63cf4b3796 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:06.139185 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-76f41b98-a5a2-47a5-933f-9e63cf4b3796 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:06.141348 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-76f41b98-a5a2-47a5-933f-9e63cf4b3796 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:06.356439 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-76f41b98-a5a2-47a5-933f-9e63cf4b3796 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:06.379824 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-76f41b98-a5a2-47a5-933f-9e63cf4b3796 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.267122 Jul 14 14:31:06.380422 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 29/67] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:06 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:06.911299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0e277abe-d575-4e30-821c-783d6d2ba0ae tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:06.912258 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-0e277abe-d575-4e30-821c-783d6d2ba0ae tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:06.918829 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0e277abe-d575-4e30-821c-783d6d2ba0ae tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:06.919274 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0e277abe-d575-4e30-821c-783d6d2ba0ae tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:06.920044 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0e277abe-d575-4e30-821c-783d6d2ba0ae tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:06.931791 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0e277abe-d575-4e30-821c-783d6d2ba0ae tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:06.962534 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-92f2737b-4e2b-4bec-8695-bb6fb86aaa2a tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:06.963935 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-92f2737b-4e2b-4bec-8695-bb6fb86aaa2a tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:06.975812 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-92f2737b-4e2b-4bec-8695-bb6fb86aaa2a tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:06.976443 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-92f2737b-4e2b-4bec-8695-bb6fb86aaa2a tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:06.977609 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-92f2737b-4e2b-4bec-8695-bb6fb86aaa2a tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:06.978251 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-92f2737b-4e2b-4bec-8695-bb6fb86aaa2a tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:07.045539 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-0e277abe-d575-4e30-821c-783d6d2ba0ae tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:07.067084 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-0e277abe-d575-4e30-821c-783d6d2ba0ae tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1242 microversion: 2.1 time: 0.161359 Jul 14 14:31:07.082940 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 39/68] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:06 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1242 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:07.196045 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-92f2737b-4e2b-4bec-8695-bb6fb86aaa2a tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:07.206365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-92f2737b-4e2b-4bec-8695-bb6fb86aaa2a tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.249551 Jul 14 14:31:07.218176 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 30/69] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:06 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:07.399637 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-aceba85b-74a4-4219-945d-cab3e7d223e2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:07.401446 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-aceba85b-74a4-4219-945d-cab3e7d223e2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:07.420841 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-aceba85b-74a4-4219-945d-cab3e7d223e2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:07.420841 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-aceba85b-74a4-4219-945d-cab3e7d223e2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:07.420841 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-aceba85b-74a4-4219-945d-cab3e7d223e2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:07.431114 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-aceba85b-74a4-4219-945d-cab3e7d223e2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:07.636121 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-aceba85b-74a4-4219-945d-cab3e7d223e2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:07.645067 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-aceba85b-74a4-4219-945d-cab3e7d223e2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.249174 Jul 14 14:31:07.646565 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 40/70] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:07 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:08.096723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0405fafd-1b58-40ae-a040-ff1a8839ebc7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:08.098737 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0405fafd-1b58-40ae-a040-ff1a8839ebc7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:08.106664 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0405fafd-1b58-40ae-a040-ff1a8839ebc7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:08.107407 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0405fafd-1b58-40ae-a040-ff1a8839ebc7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:08.108450 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0405fafd-1b58-40ae-a040-ff1a8839ebc7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:08.109120 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0405fafd-1b58-40ae-a040-ff1a8839ebc7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:08.206502 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-0405fafd-1b58-40ae-a040-ff1a8839ebc7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:08.215898 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0405fafd-1b58-40ae-a040-ff1a8839ebc7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1242 microversion: 2.1 time: 0.134346 Jul 14 14:31:08.219358 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 31/71] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:08 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1242 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:08.224338 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-9743f28e-040b-49cd-b132-a9ef74292908 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:08.224954 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-9743f28e-040b-49cd-b132-a9ef74292908 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:08.235668 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9743f28e-040b-49cd-b132-a9ef74292908 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:08.236267 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9743f28e-040b-49cd-b132-a9ef74292908 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:08.237047 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9743f28e-040b-49cd-b132-a9ef74292908 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:08.237479 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9743f28e-040b-49cd-b132-a9ef74292908 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:08.484868 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-9743f28e-040b-49cd-b132-a9ef74292908 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:08.509388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-9743f28e-040b-49cd-b132-a9ef74292908 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.288603 Jul 14 14:31:08.511316 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 41/72] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:08 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:08.663239 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-974f9f9e-f455-4529-aeef-3dba68051d73 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:08.663849 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-974f9f9e-f455-4529-aeef-3dba68051d73 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:08.680193 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-974f9f9e-f455-4529-aeef-3dba68051d73 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:08.680643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-974f9f9e-f455-4529-aeef-3dba68051d73 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:08.688205 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-974f9f9e-f455-4529-aeef-3dba68051d73 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:08.690500 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-974f9f9e-f455-4529-aeef-3dba68051d73 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:09.238533 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-3fed9c7c-ec08-4034-a40f-259741614743 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:09.239164 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-3fed9c7c-ec08-4034-a40f-259741614743 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:09.248353 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3fed9c7c-ec08-4034-a40f-259741614743 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:09.248811 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3fed9c7c-ec08-4034-a40f-259741614743 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:09.249587 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3fed9c7c-ec08-4034-a40f-259741614743 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:09.250176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3fed9c7c-ec08-4034-a40f-259741614743 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:09.382369 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-974f9f9e-f455-4529-aeef-3dba68051d73 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:09.390078 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-974f9f9e-f455-4529-aeef-3dba68051d73 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.730600 Jul 14 14:31:09.402368 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 32/73] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:08 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:09.528455 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e7cab269-5d7a-4558-9bc1-255accb431fd tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:09.530634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e7cab269-5d7a-4558-9bc1-255accb431fd tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:09.531651 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3fed9c7c-ec08-4034-a40f-259741614743 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:09.542735 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-3fed9c7c-ec08-4034-a40f-259741614743 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1290 microversion: 2.1 time: 0.314157 Jul 14 14:31:09.548668 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e7cab269-5d7a-4558-9bc1-255accb431fd tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:09.550009 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e7cab269-5d7a-4558-9bc1-255accb431fd tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:09.551444 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e7cab269-5d7a-4558-9bc1-255accb431fd tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:09.553201 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e7cab269-5d7a-4558-9bc1-255accb431fd tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:09.556902 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 42/74] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:09 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1290 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:10.123997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e7cab269-5d7a-4558-9bc1-255accb431fd tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:10.133200 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e7cab269-5d7a-4558-9bc1-255accb431fd tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.609143 Jul 14 14:31:10.133830 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 33/75] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:09 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:10.409245 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-7dee9e1d-5b8b-4a9d-a7e3-11c5218eb307 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:10.411146 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-7dee9e1d-5b8b-4a9d-a7e3-11c5218eb307 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:10.425969 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7dee9e1d-5b8b-4a9d-a7e3-11c5218eb307 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:10.427637 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7dee9e1d-5b8b-4a9d-a7e3-11c5218eb307 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:10.430011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7dee9e1d-5b8b-4a9d-a7e3-11c5218eb307 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:10.432061 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7dee9e1d-5b8b-4a9d-a7e3-11c5218eb307 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:10.564338 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-30e49005-b8d9-43dd-88e6-a532ad986d77 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:10.566203 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-30e49005-b8d9-43dd-88e6-a532ad986d77 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:10.580888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-30e49005-b8d9-43dd-88e6-a532ad986d77 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:10.581597 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-30e49005-b8d9-43dd-88e6-a532ad986d77 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:10.582569 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-30e49005-b8d9-43dd-88e6-a532ad986d77 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:10.583137 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-30e49005-b8d9-43dd-88e6-a532ad986d77 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:10.829209 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-30e49005-b8d9-43dd-88e6-a532ad986d77 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:10.844185 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-30e49005-b8d9-43dd-88e6-a532ad986d77 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1308 microversion: 2.1 time: 0.282500 Jul 14 14:31:10.845899 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 34/76] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:10 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1308 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:10.902934 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7dee9e1d-5b8b-4a9d-a7e3-11c5218eb307 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:10.925255 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-7dee9e1d-5b8b-4a9d-a7e3-11c5218eb307 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.519823 Jul 14 14:31:10.933866 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 43/77] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:10 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:11.151928 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-1ada680a-d2ff-4add-baf3-77b3fd82cdea tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:11.152796 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-1ada680a-d2ff-4add-baf3-77b3fd82cdea tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:11.166736 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1ada680a-d2ff-4add-baf3-77b3fd82cdea tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:11.167567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1ada680a-d2ff-4add-baf3-77b3fd82cdea tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:11.185559 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1ada680a-d2ff-4add-baf3-77b3fd82cdea tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:11.186052 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1ada680a-d2ff-4add-baf3-77b3fd82cdea tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:11.425339 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-a00d9035-3add-416a-9b37-68583bff8333 req-6b7e8e93-dae0-4d65-be65-caae49aa3c8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a99e8a14-f8ad-4237-9381-1f5453bca4b9", "tag": "0a7c99e8-4400-4d54-9c86-5fe83dfe11b4"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:11.458069 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-a00d9035-3add-416a-9b37-68583bff8333 req-6b7e8e93-dae0-4d65-be65-caae49aa3c8f service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:11.459535 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-a00d9035-3add-416a-9b37-68583bff8333 req-6b7e8e93-dae0-4d65-be65-caae49aa3c8f service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:11.502687 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-a00d9035-3add-416a-9b37-68583bff8333 req-6b7e8e93-dae0-4d65-be65-caae49aa3c8f service nova] Creating event network-changed:0a7c99e8-4400-4d54-9c86-5fe83dfe11b4 for instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 on hv-cinder-79987 Jul 14 14:31:11.503523 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-a00d9035-3add-416a-9b37-68583bff8333 req-6b7e8e93-dae0-4d65-be65-caae49aa3c8f service nova] Acquired lock "compute-rpcapi-router" {{(pid=118461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:31:11.505250 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-39092a2e-6802-411a-ba02-42420fac4975 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:11.505907 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-39092a2e-6802-411a-ba02-42420fac4975 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:11.507006 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-39092a2e-6802-411a-ba02-42420fac4975 None None] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:11.507633 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-39092a2e-6802-411a-ba02-42420fac4975 None None] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:11.523925 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.compute.rpcapi [None req-39092a2e-6802-411a-ba02-42420fac4975 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 14:31:11.527082 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-39092a2e-6802-411a-ba02-42420fac4975 None None] Releasing lock "compute-rpcapi-router" {{(pid=118461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:31:11.548839 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-39092a2e-6802-411a-ba02-42420fac4975 None None] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236292 Jul 14 14:31:11.550950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 44/78] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:31:11.578873 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-1ada680a-d2ff-4add-baf3-77b3fd82cdea tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:11.587639 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-1ada680a-d2ff-4add-baf3-77b3fd82cdea tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.440379 Jul 14 14:31:11.588587 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 35/79] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:11 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:11.867205 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-dc537f98-c0af-425a-b629-ea4d0cdf332d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:11.867893 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-dc537f98-c0af-425a-b629-ea4d0cdf332d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:11.874198 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dc537f98-c0af-425a-b629-ea4d0cdf332d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:11.874631 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dc537f98-c0af-425a-b629-ea4d0cdf332d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:11.876138 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dc537f98-c0af-425a-b629-ea4d0cdf332d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:11.876138 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dc537f98-c0af-425a-b629-ea4d0cdf332d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:11.945965 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-dc537f98-c0af-425a-b629-ea4d0cdf332d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:11.955613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-dc537f98-c0af-425a-b629-ea4d0cdf332d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1296 microversion: 2.1 time: 0.092522 Jul 14 14:31:11.956783 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 45/80] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:11 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:11.967104 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f364bacf-e0a9-4afa-bfb0-94d2c9d10ba1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:11.967832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f364bacf-e0a9-4afa-bfb0-94d2c9d10ba1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:11.975525 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f364bacf-e0a9-4afa-bfb0-94d2c9d10ba1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:11.976056 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f364bacf-e0a9-4afa-bfb0-94d2c9d10ba1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:11.976909 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f364bacf-e0a9-4afa-bfb0-94d2c9d10ba1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:11.977415 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f364bacf-e0a9-4afa-bfb0-94d2c9d10ba1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:12.148444 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-87d461a4-ada5-411b-b1e0-341c43d20665 req-24fb1e75-6fb4-44a4-ac05-422369c60eda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af404add-060a-4a34-ba63-b1df4171f2f2", "tag": "0e4102af-1b96-490a-9640-00a73098d3cf"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:12.150198 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f364bacf-e0a9-4afa-bfb0-94d2c9d10ba1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:12.157396 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-87d461a4-ada5-411b-b1e0-341c43d20665 req-24fb1e75-6fb4-44a4-ac05-422369c60eda service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:12.157876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-87d461a4-ada5-411b-b1e0-341c43d20665 req-24fb1e75-6fb4-44a4-ac05-422369c60eda service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:12.163772 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f364bacf-e0a9-4afa-bfb0-94d2c9d10ba1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.211253 Jul 14 14:31:12.169716 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-87d461a4-ada5-411b-b1e0-341c43d20665 req-24fb1e75-6fb4-44a4-ac05-422369c60eda service nova] Creating event network-changed:0e4102af-1b96-490a-9640-00a73098d3cf for instance af404add-060a-4a34-ba63-b1df4171f2f2 on hv-cinder-79987 Jul 14 14:31:12.173724 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 36/81] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:11 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:12.179640 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-87d461a4-ada5-411b-b1e0-341c43d20665 req-24fb1e75-6fb4-44a4-ac05-422369c60eda service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116410 Jul 14 14:31:12.180356 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 46/82] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:31:12.605135 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b03e4c94-5d51-4209-979b-099e1694de11 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:12.606752 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b03e4c94-5d51-4209-979b-099e1694de11 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:12.617716 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b03e4c94-5d51-4209-979b-099e1694de11 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:12.618213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b03e4c94-5d51-4209-979b-099e1694de11 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:12.629319 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b03e4c94-5d51-4209-979b-099e1694de11 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:12.629319 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b03e4c94-5d51-4209-979b-099e1694de11 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:12.858545 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b03e4c94-5d51-4209-979b-099e1694de11 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:12.868400 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b03e4c94-5d51-4209-979b-099e1694de11 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.267351 Jul 14 14:31:12.870927 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 37/83] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:12 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:12.976509 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4a2a4233-c193-4592-a8df-b7ef28d99719 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:12.977640 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-4a2a4233-c193-4592-a8df-b7ef28d99719 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:12.987260 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4a2a4233-c193-4592-a8df-b7ef28d99719 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:12.987855 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4a2a4233-c193-4592-a8df-b7ef28d99719 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:12.989037 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4a2a4233-c193-4592-a8df-b7ef28d99719 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:12.989709 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4a2a4233-c193-4592-a8df-b7ef28d99719 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:13.187261 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-93f2b030-cc3d-4fbc-b505-bdcaf982bed8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:13.188217 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-93f2b030-cc3d-4fbc-b505-bdcaf982bed8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:13.193439 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=6 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:13.201949 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4a2a4233-c193-4592-a8df-b7ef28d99719 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:13.203000 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4a2a4233-c193-4592-a8df-b7ef28d99719 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.233131 Jul 14 14:31:13.203803 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-93f2b030-cc3d-4fbc-b505-bdcaf982bed8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:13.204205 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 47/84] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:12 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:13.205188 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-93f2b030-cc3d-4fbc-b505-bdcaf982bed8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:13.206535 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-93f2b030-cc3d-4fbc-b505-bdcaf982bed8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:13.207576 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-93f2b030-cc3d-4fbc-b505-bdcaf982bed8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:13.240928 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=100 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:13.323347 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=26 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:13.360383 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-93f2b030-cc3d-4fbc-b505-bdcaf982bed8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:13.378133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-93f2b030-cc3d-4fbc-b505-bdcaf982bed8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.188078 Jul 14 14:31:13.378133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 38/85] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:13 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:13.886526 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e6c9f69b-9ebe-409c-84d9-8b8cfb4d6ccb tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:13.887476 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e6c9f69b-9ebe-409c-84d9-8b8cfb4d6ccb tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:13.898496 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e6c9f69b-9ebe-409c-84d9-8b8cfb4d6ccb tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:13.898496 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e6c9f69b-9ebe-409c-84d9-8b8cfb4d6ccb tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:13.898496 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e6c9f69b-9ebe-409c-84d9-8b8cfb4d6ccb tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:13.898496 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e6c9f69b-9ebe-409c-84d9-8b8cfb4d6ccb tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:13.901750 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=100 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:14.030667 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e6c9f69b-9ebe-409c-84d9-8b8cfb4d6ccb tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:14.037966 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e6c9f69b-9ebe-409c-84d9-8b8cfb4d6ccb tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.155213 Jul 14 14:31:14.038533 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 48/86] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:13 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:14.220172 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-fb842b51-f010-42b0-9296-3298c70dd45f req-d44a9bbd-853d-4744-a824-1979a4d1ed15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f52c67b1-7116-43ef-be38-0f7c6acc677f", "tag": "ac66ed7d-031b-4b52-a7dd-034845cce439"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:14.238449 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e8fb2e6e-b56a-4044-88db-6b29c5719d7b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:14.239023 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e8fb2e6e-b56a-4044-88db-6b29c5719d7b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:14.248091 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e8fb2e6e-b56a-4044-88db-6b29c5719d7b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:14.248827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e8fb2e6e-b56a-4044-88db-6b29c5719d7b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:14.252158 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e8fb2e6e-b56a-4044-88db-6b29c5719d7b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:14.253922 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e8fb2e6e-b56a-4044-88db-6b29c5719d7b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:14.254944 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:14.257206 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-fb842b51-f010-42b0-9296-3298c70dd45f req-d44a9bbd-853d-4744-a824-1979a4d1ed15 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:14.257890 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-fb842b51-f010-42b0-9296-3298c70dd45f req-d44a9bbd-853d-4744-a824-1979a4d1ed15 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:14.281410 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-fb842b51-f010-42b0-9296-3298c70dd45f req-d44a9bbd-853d-4744-a824-1979a4d1ed15 service nova] Creating event network-changed:ac66ed7d-031b-4b52-a7dd-034845cce439 for instance f52c67b1-7116-43ef-be38-0f7c6acc677f on hv-cinder-79987 Jul 14 14:31:14.282601 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-fb842b51-f010-42b0-9296-3298c70dd45f req-d44a9bbd-853d-4744-a824-1979a4d1ed15 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:31:14.284056 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-34e873df-8313-4fdd-ba49-1c57dfde41d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:14.284997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-34e873df-8313-4fdd-ba49-1c57dfde41d7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:14.286169 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-34e873df-8313-4fdd-ba49-1c57dfde41d7 None None] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:14.289488 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-34e873df-8313-4fdd-ba49-1c57dfde41d7 None None] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:14.300636 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.compute.rpcapi [None req-34e873df-8313-4fdd-ba49-1c57dfde41d7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 14:31:14.302416 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-34e873df-8313-4fdd-ba49-1c57dfde41d7 None None] Releasing lock "compute-rpcapi-router" {{(pid=118462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:31:14.320189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-34e873df-8313-4fdd-ba49-1c57dfde41d7 None None] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103907 Jul 14 14:31:14.324179 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 39/87] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:31:14.392262 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-cfdc63a3-9e0d-4b5e-b637-403122052348 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:14.393277 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-cfdc63a3-9e0d-4b5e-b637-403122052348 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:14.408938 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cfdc63a3-9e0d-4b5e-b637-403122052348 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:14.409380 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cfdc63a3-9e0d-4b5e-b637-403122052348 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:14.412683 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cfdc63a3-9e0d-4b5e-b637-403122052348 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:14.413121 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cfdc63a3-9e0d-4b5e-b637-403122052348 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:14.497350 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e8fb2e6e-b56a-4044-88db-6b29c5719d7b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:14.507371 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e8fb2e6e-b56a-4044-88db-6b29c5719d7b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.283745 Jul 14 14:31:14.510118 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 49/88] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:14 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:14.615709 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-cfdc63a3-9e0d-4b5e-b637-403122052348 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:14.626261 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-cfdc63a3-9e0d-4b5e-b637-403122052348 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.242029 Jul 14 14:31:14.633872 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 40/89] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:14 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:15.057133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f31936de-a947-4ef8-86e0-1ea8125e46bf tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:15.058431 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-f31936de-a947-4ef8-86e0-1ea8125e46bf tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:15.072989 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=18 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:15.074803 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f31936de-a947-4ef8-86e0-1ea8125e46bf tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:15.085917 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f31936de-a947-4ef8-86e0-1ea8125e46bf tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:15.085917 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f31936de-a947-4ef8-86e0-1ea8125e46bf tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:15.085917 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f31936de-a947-4ef8-86e0-1ea8125e46bf tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:15.364180 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-f31936de-a947-4ef8-86e0-1ea8125e46bf tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:15.375016 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-f31936de-a947-4ef8-86e0-1ea8125e46bf tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.322865 Jul 14 14:31:15.376411 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 50/90] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:15 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:15.527367 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-79a715c9-ae5a-43d2-ae48-b4de32f374ab tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:15.528085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-79a715c9-ae5a-43d2-ae48-b4de32f374ab tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:15.535984 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-79a715c9-ae5a-43d2-ae48-b4de32f374ab tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:15.536462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-79a715c9-ae5a-43d2-ae48-b4de32f374ab tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:15.537201 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-79a715c9-ae5a-43d2-ae48-b4de32f374ab tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:15.537636 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-79a715c9-ae5a-43d2-ae48-b4de32f374ab tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:15.642893 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b5510237-4ca1-4c6e-984f-ddf1d3f221d1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:15.645271 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b5510237-4ca1-4c6e-984f-ddf1d3f221d1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:15.659553 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b5510237-4ca1-4c6e-984f-ddf1d3f221d1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:15.665082 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b5510237-4ca1-4c6e-984f-ddf1d3f221d1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:15.667170 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b5510237-4ca1-4c6e-984f-ddf1d3f221d1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:15.668356 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b5510237-4ca1-4c6e-984f-ddf1d3f221d1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:16.292793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b5510237-4ca1-4c6e-984f-ddf1d3f221d1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:16.300270 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b5510237-4ca1-4c6e-984f-ddf1d3f221d1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.661126 Jul 14 14:31:16.300851 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 51/91] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:15 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:16.309476 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-79a715c9-ae5a-43d2-ae48-b4de32f374ab tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:16.321293 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-79a715c9-ae5a-43d2-ae48-b4de32f374ab tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.799023 Jul 14 14:31:16.331949 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 41/92] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:15 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:16.395378 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-32eed4e7-a3b2-48f9-87fb-c3e2dc2756f4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:16.396269 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-32eed4e7-a3b2-48f9-87fb-c3e2dc2756f4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:16.412820 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:16.432303 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-32eed4e7-a3b2-48f9-87fb-c3e2dc2756f4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:16.432762 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-32eed4e7-a3b2-48f9-87fb-c3e2dc2756f4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:16.436604 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-32eed4e7-a3b2-48f9-87fb-c3e2dc2756f4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:16.439774 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-32eed4e7-a3b2-48f9-87fb-c3e2dc2756f4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:16.915699 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-32eed4e7-a3b2-48f9-87fb-c3e2dc2756f4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:16.946119 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-32eed4e7-a3b2-48f9-87fb-c3e2dc2756f4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.542422 Jul 14 14:31:16.952419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 52/93] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:16 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:17.317918 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-12a6eb66-0441-4486-813f-d4a92f4c6f8a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:17.319272 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-12a6eb66-0441-4486-813f-d4a92f4c6f8a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:17.330360 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-12a6eb66-0441-4486-813f-d4a92f4c6f8a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:17.334054 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-12a6eb66-0441-4486-813f-d4a92f4c6f8a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:17.340285 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-00937707-dcaa-4bee-b850-3c78c821b71e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:17.341635 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-00937707-dcaa-4bee-b850-3c78c821b71e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:17.347239 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-12a6eb66-0441-4486-813f-d4a92f4c6f8a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:17.349910 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-00937707-dcaa-4bee-b850-3c78c821b71e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:17.352539 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-12a6eb66-0441-4486-813f-d4a92f4c6f8a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:17.359879 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-00937707-dcaa-4bee-b850-3c78c821b71e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:17.365819 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-00937707-dcaa-4bee-b850-3c78c821b71e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:17.366476 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-00937707-dcaa-4bee-b850-3c78c821b71e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:17.744828 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-00937707-dcaa-4bee-b850-3c78c821b71e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:17.772713 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-00937707-dcaa-4bee-b850-3c78c821b71e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.435955 Jul 14 14:31:17.786190 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 53/94] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:17 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:17.972740 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b3736a5f-7ef6-4406-bc1c-6ae5ee67417c tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:17.973712 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b3736a5f-7ef6-4406-bc1c-6ae5ee67417c tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:17.987984 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b3736a5f-7ef6-4406-bc1c-6ae5ee67417c tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:17.988556 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b3736a5f-7ef6-4406-bc1c-6ae5ee67417c tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:17.989720 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b3736a5f-7ef6-4406-bc1c-6ae5ee67417c tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:17.990238 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b3736a5f-7ef6-4406-bc1c-6ae5ee67417c tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:18.009246 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-12a6eb66-0441-4486-813f-d4a92f4c6f8a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:18.018048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-12a6eb66-0441-4486-813f-d4a92f4c6f8a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.704438 Jul 14 14:31:18.098553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 42/95] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:17 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:18.239011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b3736a5f-7ef6-4406-bc1c-6ae5ee67417c tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:18.256477 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b3736a5f-7ef6-4406-bc1c-6ae5ee67417c tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.288658 Jul 14 14:31:18.257819 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 54/96] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:17 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:18.730234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-8681dda8-14a0-4069-a0f5-b856b6070409 req-f5839494-1600-44d9-8708-5580b249c5f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e8bc61-9b48-4f75-b6cf-c0c05b28aad0", "tag": "8ef3b15c-bd64-4c1c-8a46-268bb86b551d"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:18.739307 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-8681dda8-14a0-4069-a0f5-b856b6070409 req-f5839494-1600-44d9-8708-5580b249c5f9 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:18.740010 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-8681dda8-14a0-4069-a0f5-b856b6070409 req-f5839494-1600-44d9-8708-5580b249c5f9 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:18.782552 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-8681dda8-14a0-4069-a0f5-b856b6070409 req-f5839494-1600-44d9-8708-5580b249c5f9 service nova] Creating event network-changed:8ef3b15c-bd64-4c1c-8a46-268bb86b551d for instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 on hv-cinder-79987 Jul 14 14:31:18.791988 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c827fcc1-8f23-4ff3-ab0e-7b6ff005f53e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:18.793909 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-8681dda8-14a0-4069-a0f5-b856b6070409 req-f5839494-1600-44d9-8708-5580b249c5f9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068300 Jul 14 14:31:18.794046 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c827fcc1-8f23-4ff3-ab0e-7b6ff005f53e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:18.795360 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 43/97] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:18.803595 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c827fcc1-8f23-4ff3-ab0e-7b6ff005f53e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:18.804167 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c827fcc1-8f23-4ff3-ab0e-7b6ff005f53e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:18.805148 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c827fcc1-8f23-4ff3-ab0e-7b6ff005f53e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:18.805682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c827fcc1-8f23-4ff3-ab0e-7b6ff005f53e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:19.007183 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c827fcc1-8f23-4ff3-ab0e-7b6ff005f53e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:19.015263 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c827fcc1-8f23-4ff3-ab0e-7b6ff005f53e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.227797 Jul 14 14:31:19.016165 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 55/98] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:18 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:19.106913 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b77ce0b9-432e-4754-a669-7ae2d7c97f8f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:19.107603 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b77ce0b9-432e-4754-a669-7ae2d7c97f8f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:19.113819 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b77ce0b9-432e-4754-a669-7ae2d7c97f8f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:19.114263 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b77ce0b9-432e-4754-a669-7ae2d7c97f8f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:19.115003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b77ce0b9-432e-4754-a669-7ae2d7c97f8f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:19.115429 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b77ce0b9-432e-4754-a669-7ae2d7c97f8f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:19.245972 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b77ce0b9-432e-4754-a669-7ae2d7c97f8f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:19.253423 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b77ce0b9-432e-4754-a669-7ae2d7c97f8f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.150969 Jul 14 14:31:19.254023 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 44/99] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:19 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:19.273499 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-8c8d44aa-0259-4f6f-be73-f0c44b73e5de tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:19.274136 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-8c8d44aa-0259-4f6f-be73-f0c44b73e5de tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:19.280612 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8c8d44aa-0259-4f6f-be73-f0c44b73e5de tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:19.281056 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8c8d44aa-0259-4f6f-be73-f0c44b73e5de tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:19.281883 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8c8d44aa-0259-4f6f-be73-f0c44b73e5de tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:19.282269 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8c8d44aa-0259-4f6f-be73-f0c44b73e5de tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:19.410282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-8c8d44aa-0259-4f6f-be73-f0c44b73e5de tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:19.417915 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-8c8d44aa-0259-4f6f-be73-f0c44b73e5de tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.148365 Jul 14 14:31:19.418486 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 56/100] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:19 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:20.031845 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0ba1f407-e025-4b2c-9afa-742ed7f3a901 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:20.032455 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0ba1f407-e025-4b2c-9afa-742ed7f3a901 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:20.038502 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ba1f407-e025-4b2c-9afa-742ed7f3a901 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:20.038952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ba1f407-e025-4b2c-9afa-742ed7f3a901 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:20.039707 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ba1f407-e025-4b2c-9afa-742ed7f3a901 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:20.040163 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ba1f407-e025-4b2c-9afa-742ed7f3a901 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:20.182018 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-0ba1f407-e025-4b2c-9afa-742ed7f3a901 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:20.189916 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0ba1f407-e025-4b2c-9afa-742ed7f3a901 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.161839 Jul 14 14:31:20.190485 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 45/101] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:20 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:20.270781 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-533a75a3-eb93-4493-b84c-ec0f30e49397 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:20.271468 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-533a75a3-eb93-4493-b84c-ec0f30e49397 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:20.278184 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-533a75a3-eb93-4493-b84c-ec0f30e49397 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:20.278634 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-533a75a3-eb93-4493-b84c-ec0f30e49397 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:20.279392 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-533a75a3-eb93-4493-b84c-ec0f30e49397 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:20.279824 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-533a75a3-eb93-4493-b84c-ec0f30e49397 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:20.409139 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-533a75a3-eb93-4493-b84c-ec0f30e49397 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:20.416913 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-533a75a3-eb93-4493-b84c-ec0f30e49397 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.150005 Jul 14 14:31:20.417470 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 57/102] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:20 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:20.434736 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-9db53261-9c05-4aa5-abe8-76f2d9751fba tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:20.435342 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-9db53261-9c05-4aa5-abe8-76f2d9751fba tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:20.441282 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9db53261-9c05-4aa5-abe8-76f2d9751fba tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:20.441723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9db53261-9c05-4aa5-abe8-76f2d9751fba tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:20.442511 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9db53261-9c05-4aa5-abe8-76f2d9751fba tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:20.442934 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9db53261-9c05-4aa5-abe8-76f2d9751fba tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:20.575650 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-9db53261-9c05-4aa5-abe8-76f2d9751fba tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:20.583247 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-9db53261-9c05-4aa5-abe8-76f2d9751fba tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.152375 Jul 14 14:31:20.583828 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 46/103] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:20 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:21.206168 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f429879a-8257-4460-b919-5ac4e87ac465 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:21.206775 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-f429879a-8257-4460-b919-5ac4e87ac465 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:21.212675 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f429879a-8257-4460-b919-5ac4e87ac465 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.213113 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f429879a-8257-4460-b919-5ac4e87ac465 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.213887 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f429879a-8257-4460-b919-5ac4e87ac465 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.214316 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f429879a-8257-4460-b919-5ac4e87ac465 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.339677 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-f429879a-8257-4460-b919-5ac4e87ac465 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:21.351340 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-f429879a-8257-4460-b919-5ac4e87ac465 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.144804 Jul 14 14:31:21.351340 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 58/104] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:21 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:21.435693 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ad48398c-cb53-4e95-ac8c-a5dbd9bc24fa tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:21.436437 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ad48398c-cb53-4e95-ac8c-a5dbd9bc24fa tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:21.442603 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ad48398c-cb53-4e95-ac8c-a5dbd9bc24fa tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.443046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ad48398c-cb53-4e95-ac8c-a5dbd9bc24fa tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.443796 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ad48398c-cb53-4e95-ac8c-a5dbd9bc24fa tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.444224 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ad48398c-cb53-4e95-ac8c-a5dbd9bc24fa tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.600314 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-1e4612fe-ba0e-48c6-a89e-5d5aabb195dd tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:21.601052 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-1e4612fe-ba0e-48c6-a89e-5d5aabb195dd tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:21.609085 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:21.609365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ad48398c-cb53-4e95-ac8c-a5dbd9bc24fa tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:21.609481 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1e4612fe-ba0e-48c6-a89e-5d5aabb195dd tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.609481 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1e4612fe-ba0e-48c6-a89e-5d5aabb195dd tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.610520 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1e4612fe-ba0e-48c6-a89e-5d5aabb195dd tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:21.610947 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1e4612fe-ba0e-48c6-a89e-5d5aabb195dd tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:21.614756 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ad48398c-cb53-4e95-ac8c-a5dbd9bc24fa tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.183537 Jul 14 14:31:21.615347 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 47/105] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:21 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:21.748798 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-1e4612fe-ba0e-48c6-a89e-5d5aabb195dd tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:21.772731 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-1e4612fe-ba0e-48c6-a89e-5d5aabb195dd tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.175416 Jul 14 14:31:21.773973 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 59/106] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:21 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:22.364239 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-2cd4e6a1-df25-4099-b8cf-4e6fcd3e6553 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:22.364835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-2cd4e6a1-df25-4099-b8cf-4e6fcd3e6553 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:22.371481 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2cd4e6a1-df25-4099-b8cf-4e6fcd3e6553 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:22.371917 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2cd4e6a1-df25-4099-b8cf-4e6fcd3e6553 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:22.372658 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2cd4e6a1-df25-4099-b8cf-4e6fcd3e6553 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:22.373081 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2cd4e6a1-df25-4099-b8cf-4e6fcd3e6553 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:22.504326 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-2cd4e6a1-df25-4099-b8cf-4e6fcd3e6553 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:22.519610 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-2cd4e6a1-df25-4099-b8cf-4e6fcd3e6553 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.151673 Jul 14 14:31:22.519610 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 48/107] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:22 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:22.631747 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-897b3831-4570-489f-ba78-802736cfa974 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:22.632499 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-897b3831-4570-489f-ba78-802736cfa974 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:22.638631 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-897b3831-4570-489f-ba78-802736cfa974 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:22.639081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-897b3831-4570-489f-ba78-802736cfa974 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:22.639844 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-897b3831-4570-489f-ba78-802736cfa974 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:22.640276 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-897b3831-4570-489f-ba78-802736cfa974 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:22.773471 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-897b3831-4570-489f-ba78-802736cfa974 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:22.782352 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-897b3831-4570-489f-ba78-802736cfa974 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.154938 Jul 14 14:31:22.784393 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 60/108] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:22 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:22.798147 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-52b532e5-588a-4db0-ba90-d7b527ab2b44 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:22.798746 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-52b532e5-588a-4db0-ba90-d7b527ab2b44 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:22.804721 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-52b532e5-588a-4db0-ba90-d7b527ab2b44 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:22.805164 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-52b532e5-588a-4db0-ba90-d7b527ab2b44 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:22.805994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-52b532e5-588a-4db0-ba90-d7b527ab2b44 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:22.807180 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-52b532e5-588a-4db0-ba90-d7b527ab2b44 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:22.964990 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-52b532e5-588a-4db0-ba90-d7b527ab2b44 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:22.973012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-52b532e5-588a-4db0-ba90-d7b527ab2b44 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.179837 Jul 14 14:31:22.973663 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 49/109] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:22 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:23.534463 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-40aae007-b605-4b6e-b88b-4c73dde8923a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:23.535163 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-40aae007-b605-4b6e-b88b-4c73dde8923a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:23.541796 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-40aae007-b605-4b6e-b88b-4c73dde8923a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:23.542261 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-40aae007-b605-4b6e-b88b-4c73dde8923a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:23.543022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-40aae007-b605-4b6e-b88b-4c73dde8923a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:23.543453 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-40aae007-b605-4b6e-b88b-4c73dde8923a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:23.706878 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-40aae007-b605-4b6e-b88b-4c73dde8923a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:23.706878 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-40aae007-b605-4b6e-b88b-4c73dde8923a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.175077 Jul 14 14:31:23.706878 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 61/110] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:23 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:23.799794 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c718f766-d9b1-42dc-88d5-79c62b49d7af tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:23.800501 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c718f766-d9b1-42dc-88d5-79c62b49d7af tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:23.806483 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c718f766-d9b1-42dc-88d5-79c62b49d7af tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:23.806920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c718f766-d9b1-42dc-88d5-79c62b49d7af tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:23.807853 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c718f766-d9b1-42dc-88d5-79c62b49d7af tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:23.808277 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c718f766-d9b1-42dc-88d5-79c62b49d7af tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:23.938900 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-c718f766-d9b1-42dc-88d5-79c62b49d7af tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:23.947851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c718f766-d9b1-42dc-88d5-79c62b49d7af tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.151235 Jul 14 14:31:23.948317 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 50/111] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:23 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:23.992899 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-121a6454-0b3a-4fb1-8246-25324fbe3c1d tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:23.993512 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-121a6454-0b3a-4fb1-8246-25324fbe3c1d tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:23.999983 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-121a6454-0b3a-4fb1-8246-25324fbe3c1d tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:24.000427 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-121a6454-0b3a-4fb1-8246-25324fbe3c1d tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:24.001185 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-121a6454-0b3a-4fb1-8246-25324fbe3c1d tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:24.002089 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-121a6454-0b3a-4fb1-8246-25324fbe3c1d tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:24.138773 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-121a6454-0b3a-4fb1-8246-25324fbe3c1d tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:24.147481 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-121a6454-0b3a-4fb1-8246-25324fbe3c1d tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.158406 Jul 14 14:31:24.148044 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 62/112] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:23 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:24.724156 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-bdeed19f-54a6-4b5d-ae26-214df89d3581 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:24.724759 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-bdeed19f-54a6-4b5d-ae26-214df89d3581 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:24.726729 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=2 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:24.731910 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bdeed19f-54a6-4b5d-ae26-214df89d3581 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:24.732353 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bdeed19f-54a6-4b5d-ae26-214df89d3581 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:24.733109 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bdeed19f-54a6-4b5d-ae26-214df89d3581 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:24.733540 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bdeed19f-54a6-4b5d-ae26-214df89d3581 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:24.884895 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-bdeed19f-54a6-4b5d-ae26-214df89d3581 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:24.892364 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-bdeed19f-54a6-4b5d-ae26-214df89d3581 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.171987 Jul 14 14:31:24.892958 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 51/113] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:24 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:24.964595 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-2bfe68c2-0a25-43a3-973e-dc48e47a2ee4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:24.965199 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-2bfe68c2-0a25-43a3-973e-dc48e47a2ee4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:24.971363 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2bfe68c2-0a25-43a3-973e-dc48e47a2ee4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:24.971809 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2bfe68c2-0a25-43a3-973e-dc48e47a2ee4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:24.972558 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2bfe68c2-0a25-43a3-973e-dc48e47a2ee4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:24.972985 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2bfe68c2-0a25-43a3-973e-dc48e47a2ee4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:25.111597 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-2bfe68c2-0a25-43a3-973e-dc48e47a2ee4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:25.119569 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-2bfe68c2-0a25-43a3-973e-dc48e47a2ee4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.158384 Jul 14 14:31:25.120106 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 63/114] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:24 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:25.165019 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e294c3de-2828-4351-979d-a78b760ac54e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:25.165759 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e294c3de-2828-4351-979d-a78b760ac54e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:25.171914 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e294c3de-2828-4351-979d-a78b760ac54e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:25.172357 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e294c3de-2828-4351-979d-a78b760ac54e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:25.173359 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e294c3de-2828-4351-979d-a78b760ac54e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:25.174467 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e294c3de-2828-4351-979d-a78b760ac54e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:25.313366 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e294c3de-2828-4351-979d-a78b760ac54e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:25.320896 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e294c3de-2828-4351-979d-a78b760ac54e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.160547 Jul 14 14:31:25.321464 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 52/115] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:25 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:25.908865 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-2025f5f9-e09c-4fd5-bb38-03bfc0a1e66e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:25.916236 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-2025f5f9-e09c-4fd5-bb38-03bfc0a1e66e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:25.917481 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2025f5f9-e09c-4fd5-bb38-03bfc0a1e66e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:25.918108 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2025f5f9-e09c-4fd5-bb38-03bfc0a1e66e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:25.919050 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2025f5f9-e09c-4fd5-bb38-03bfc0a1e66e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:25.919635 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2025f5f9-e09c-4fd5-bb38-03bfc0a1e66e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:26.125427 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-2025f5f9-e09c-4fd5-bb38-03bfc0a1e66e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:26.128880 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=100 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:26.137662 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-2025f5f9-e09c-4fd5-bb38-03bfc0a1e66e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.232016 Jul 14 14:31:26.138548 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 64/116] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:25 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:26.141272 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-97d72ae5-8c63-4932-bbdb-96421e22dd6b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:26.142606 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-97d72ae5-8c63-4932-bbdb-96421e22dd6b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:26.152207 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-97d72ae5-8c63-4932-bbdb-96421e22dd6b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:26.152670 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-97d72ae5-8c63-4932-bbdb-96421e22dd6b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:26.153423 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-97d72ae5-8c63-4932-bbdb-96421e22dd6b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:26.153875 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-97d72ae5-8c63-4932-bbdb-96421e22dd6b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:26.325750 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-97d72ae5-8c63-4932-bbdb-96421e22dd6b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:26.341227 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-90fe0724-04ba-4d18-a185-c259557b4e20 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:26.342203 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-90fe0724-04ba-4d18-a185-c259557b4e20 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:26.349420 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-97d72ae5-8c63-4932-bbdb-96421e22dd6b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.214151 Jul 14 14:31:26.366127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 53/117] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:26 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:26.366307 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-90fe0724-04ba-4d18-a185-c259557b4e20 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:26.366307 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-90fe0724-04ba-4d18-a185-c259557b4e20 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:26.366307 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-90fe0724-04ba-4d18-a185-c259557b4e20 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:26.366307 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-90fe0724-04ba-4d18-a185-c259557b4e20 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:26.495666 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-90fe0724-04ba-4d18-a185-c259557b4e20 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:26.508563 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-90fe0724-04ba-4d18-a185-c259557b4e20 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.172129 Jul 14 14:31:26.509143 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 65/118] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:26 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:27.154503 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-368f8d7e-a328-4e6b-84c3-4cbc7149480a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:27.155114 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-368f8d7e-a328-4e6b-84c3-4cbc7149480a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:27.161130 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-368f8d7e-a328-4e6b-84c3-4cbc7149480a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:27.161578 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-368f8d7e-a328-4e6b-84c3-4cbc7149480a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:27.162462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-368f8d7e-a328-4e6b-84c3-4cbc7149480a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:27.162897 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-368f8d7e-a328-4e6b-84c3-4cbc7149480a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:27.381881 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-41b5695c-7eca-407a-9d42-080f4daf7a02 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:27.382471 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-41b5695c-7eca-407a-9d42-080f4daf7a02 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:27.396127 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-41b5695c-7eca-407a-9d42-080f4daf7a02 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:27.396579 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-41b5695c-7eca-407a-9d42-080f4daf7a02 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:27.397353 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-41b5695c-7eca-407a-9d42-080f4daf7a02 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:27.397817 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-41b5695c-7eca-407a-9d42-080f4daf7a02 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:27.552078 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-368f8d7e-a328-4e6b-84c3-4cbc7149480a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:27.560128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-368f8d7e-a328-4e6b-84c3-4cbc7149480a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.410128 Jul 14 14:31:27.560745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 54/119] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:27 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:27.565997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-35ad9005-a57a-4beb-919b-28c73601f7ff tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:27.567249 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-35ad9005-a57a-4beb-919b-28c73601f7ff tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:27.574159 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-35ad9005-a57a-4beb-919b-28c73601f7ff tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:27.574604 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-35ad9005-a57a-4beb-919b-28c73601f7ff tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:27.575358 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-35ad9005-a57a-4beb-919b-28c73601f7ff tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:27.575783 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-35ad9005-a57a-4beb-919b-28c73601f7ff tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:27.589106 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-41b5695c-7eca-407a-9d42-080f4daf7a02 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:27.598133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-41b5695c-7eca-407a-9d42-080f4daf7a02 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.220014 Jul 14 14:31:27.598749 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 66/120] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:27 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:27.801081 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-35ad9005-a57a-4beb-919b-28c73601f7ff tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:27.810277 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-35ad9005-a57a-4beb-919b-28c73601f7ff tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.248329 Jul 14 14:31:27.811469 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 55/121] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:27 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:28.577165 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-1d2aa50c-4c9c-4af7-ab60-250caf5609e2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:28.578085 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-1d2aa50c-4c9c-4af7-ab60-250caf5609e2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:28.584292 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1d2aa50c-4c9c-4af7-ab60-250caf5609e2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:28.584737 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1d2aa50c-4c9c-4af7-ab60-250caf5609e2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:28.585500 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1d2aa50c-4c9c-4af7-ab60-250caf5609e2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:28.585963 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1d2aa50c-4c9c-4af7-ab60-250caf5609e2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:28.616083 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a5dd9423-5fcb-4425-9a30-9f9681eec83c tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:28.616695 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a5dd9423-5fcb-4425-9a30-9f9681eec83c tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:28.623840 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a5dd9423-5fcb-4425-9a30-9f9681eec83c tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:28.624287 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a5dd9423-5fcb-4425-9a30-9f9681eec83c tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:28.625107 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a5dd9423-5fcb-4425-9a30-9f9681eec83c tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:28.625497 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a5dd9423-5fcb-4425-9a30-9f9681eec83c tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:28.638441 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=100 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:28.788302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-1d2aa50c-4c9c-4af7-ab60-250caf5609e2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:28.809701 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-1d2aa50c-4c9c-4af7-ab60-250caf5609e2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.225751 Jul 14 14:31:28.811644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 67/122] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:28 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:28.829634 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-9634ff14-769e-47af-8c3c-b1b895866901 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:28.830221 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a5dd9423-5fcb-4425-9a30-9f9681eec83c tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:28.831108 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-9634ff14-769e-47af-8c3c-b1b895866901 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:28.841996 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a5dd9423-5fcb-4425-9a30-9f9681eec83c tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.229983 Jul 14 14:31:28.855799 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 56/123] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:28 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:28.856767 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9634ff14-769e-47af-8c3c-b1b895866901 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:28.856767 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9634ff14-769e-47af-8c3c-b1b895866901 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:28.860857 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9634ff14-769e-47af-8c3c-b1b895866901 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:28.861313 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9634ff14-769e-47af-8c3c-b1b895866901 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:29.007472 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-9634ff14-769e-47af-8c3c-b1b895866901 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:29.015354 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-9634ff14-769e-47af-8c3c-b1b895866901 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.191591 Jul 14 14:31:29.015938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 68/124] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:28 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:29.833022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-769af771-2f0d-4f0c-8e12-3be46db5c65c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:29.833706 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-769af771-2f0d-4f0c-8e12-3be46db5c65c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:29.841225 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-769af771-2f0d-4f0c-8e12-3be46db5c65c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:29.841677 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-769af771-2f0d-4f0c-8e12-3be46db5c65c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:29.842480 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-769af771-2f0d-4f0c-8e12-3be46db5c65c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:29.842915 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-769af771-2f0d-4f0c-8e12-3be46db5c65c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:29.864257 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4bdfe202-8e61-4c43-aed1-47c487ac481d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:29.864860 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-4bdfe202-8e61-4c43-aed1-47c487ac481d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:29.871464 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4bdfe202-8e61-4c43-aed1-47c487ac481d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:29.871912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4bdfe202-8e61-4c43-aed1-47c487ac481d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:29.872858 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4bdfe202-8e61-4c43-aed1-47c487ac481d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:29.873299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4bdfe202-8e61-4c43-aed1-47c487ac481d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:30.058947 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-769af771-2f0d-4f0c-8e12-3be46db5c65c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:30.059535 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4bdfe202-8e61-4c43-aed1-47c487ac481d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:30.068764 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4bdfe202-8e61-4c43-aed1-47c487ac481d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.208470 Jul 14 14:31:30.068913 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-769af771-2f0d-4f0c-8e12-3be46db5c65c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.240132 Jul 14 14:31:30.069329 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 69/125] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:29 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:30.077609 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 57/126] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:29 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:30.078095 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-cbd1b68d-b263-483b-9a2f-9b7e72dd059e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:30.078855 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-cbd1b68d-b263-483b-9a2f-9b7e72dd059e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:30.085382 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cbd1b68d-b263-483b-9a2f-9b7e72dd059e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:30.085880 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cbd1b68d-b263-483b-9a2f-9b7e72dd059e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:30.089233 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cbd1b68d-b263-483b-9a2f-9b7e72dd059e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:30.089233 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cbd1b68d-b263-483b-9a2f-9b7e72dd059e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:30.219187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-cbd1b68d-b263-483b-9a2f-9b7e72dd059e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:30.226933 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-cbd1b68d-b263-483b-9a2f-9b7e72dd059e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.156442 Jul 14 14:31:30.227507 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 70/127] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:30 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:31.086306 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7c8e8f1c-a43f-4cc0-bd23-881b12f7532d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:31.086825 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-86490286-cdfc-49b8-9fc7-61bf49c8e6e8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:31.087202 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-7c8e8f1c-a43f-4cc0-bd23-881b12f7532d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:31.087292 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-86490286-cdfc-49b8-9fc7-61bf49c8e6e8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:31.093131 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-86490286-cdfc-49b8-9fc7-61bf49c8e6e8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:31.093282 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7c8e8f1c-a43f-4cc0-bd23-881b12f7532d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:31.094154 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-86490286-cdfc-49b8-9fc7-61bf49c8e6e8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:31.094257 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7c8e8f1c-a43f-4cc0-bd23-881b12f7532d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:31.094692 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7c8e8f1c-a43f-4cc0-bd23-881b12f7532d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:31.094813 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-86490286-cdfc-49b8-9fc7-61bf49c8e6e8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:31.095043 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7c8e8f1c-a43f-4cc0-bd23-881b12f7532d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:31.095257 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-86490286-cdfc-49b8-9fc7-61bf49c8e6e8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:31.321419 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7c8e8f1c-a43f-4cc0-bd23-881b12f7532d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:31.329142 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-7c8e8f1c-a43f-4cc0-bd23-881b12f7532d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.246834 Jul 14 14:31:31.329728 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 58/128] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:31 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:31.334239 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ac58ea98-9013-449b-a22f-915304b166ea tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:31.334977 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ac58ea98-9013-449b-a22f-915304b166ea tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:31.338902 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-86490286-cdfc-49b8-9fc7-61bf49c8e6e8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:31.342277 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ac58ea98-9013-449b-a22f-915304b166ea tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:31.342729 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ac58ea98-9013-449b-a22f-915304b166ea tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:31.343490 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ac58ea98-9013-449b-a22f-915304b166ea tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:31.343922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ac58ea98-9013-449b-a22f-915304b166ea tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:31.347128 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-86490286-cdfc-49b8-9fc7-61bf49c8e6e8 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.264799 Jul 14 14:31:31.347696 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 71/129] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:31 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:31.479122 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ac58ea98-9013-449b-a22f-915304b166ea tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:31.487047 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ac58ea98-9013-449b-a22f-915304b166ea tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.156294 Jul 14 14:31:31.487626 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 59/130] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:31 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:32.347343 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0055b337-38ba-473e-982e-531b7eed529d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:32.347989 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-0055b337-38ba-473e-982e-531b7eed529d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:32.354609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0055b337-38ba-473e-982e-531b7eed529d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:32.355058 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0055b337-38ba-473e-982e-531b7eed529d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:32.355816 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0055b337-38ba-473e-982e-531b7eed529d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:32.356504 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0055b337-38ba-473e-982e-531b7eed529d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:32.364604 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-96880f6a-9ac2-4c29-9594-0f190259bf78 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:32.367220 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-96880f6a-9ac2-4c29-9594-0f190259bf78 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:32.372056 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-96880f6a-9ac2-4c29-9594-0f190259bf78 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:32.372502 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-96880f6a-9ac2-4c29-9594-0f190259bf78 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:32.373265 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-96880f6a-9ac2-4c29-9594-0f190259bf78 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:32.373695 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-96880f6a-9ac2-4c29-9594-0f190259bf78 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:32.563769 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-0055b337-38ba-473e-982e-531b7eed529d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:32.572227 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-0055b337-38ba-473e-982e-531b7eed529d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.228997 Jul 14 14:31:32.572802 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 72/131] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:32 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:32.573445 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-96880f6a-9ac2-4c29-9594-0f190259bf78 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:32.577541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ad1511a0-99b2-444c-8a08-66a990fb6f53 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:32.580321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-ad1511a0-99b2-444c-8a08-66a990fb6f53 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:32.582113 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-96880f6a-9ac2-4c29-9594-0f190259bf78 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.221437 Jul 14 14:31:32.582697 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 60/132] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:32 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:32.584511 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ad1511a0-99b2-444c-8a08-66a990fb6f53 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:32.584948 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ad1511a0-99b2-444c-8a08-66a990fb6f53 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:32.585700 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ad1511a0-99b2-444c-8a08-66a990fb6f53 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:32.586151 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ad1511a0-99b2-444c-8a08-66a990fb6f53 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:32.727177 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-ad1511a0-99b2-444c-8a08-66a990fb6f53 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:32.735529 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-ad1511a0-99b2-444c-8a08-66a990fb6f53 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.161730 Jul 14 14:31:32.736104 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 73/133] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:32 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:33.589530 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-528e8f49-8a37-49d4-afc1-fcfb85991190 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:33.590284 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-528e8f49-8a37-49d4-afc1-fcfb85991190 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:33.608095 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-528e8f49-8a37-49d4-afc1-fcfb85991190 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.622016 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-528e8f49-8a37-49d4-afc1-fcfb85991190 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:33.622016 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-528e8f49-8a37-49d4-afc1-fcfb85991190 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.622016 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-528e8f49-8a37-49d4-afc1-fcfb85991190 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:33.628375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-35e17938-ad61-47ed-92c4-692e3a48761e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:33.631421 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-35e17938-ad61-47ed-92c4-692e3a48761e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:33.652023 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-35e17938-ad61-47ed-92c4-692e3a48761e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.652481 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-35e17938-ad61-47ed-92c4-692e3a48761e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:33.656283 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-35e17938-ad61-47ed-92c4-692e3a48761e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.656736 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-35e17938-ad61-47ed-92c4-692e3a48761e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:33.897204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-528e8f49-8a37-49d4-afc1-fcfb85991190 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:33.906118 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-528e8f49-8a37-49d4-afc1-fcfb85991190 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.321495 Jul 14 14:31:33.907426 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 61/134] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:33 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:33.940387 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-35e17938-ad61-47ed-92c4-692e3a48761e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:33.949368 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-35e17938-ad61-47ed-92c4-692e3a48761e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.346886 Jul 14 14:31:33.949994 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 74/135] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:33 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:33.974270 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-72e56bc4-30e7-469e-95f1-060a6db1c5af tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:33.974270 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-72e56bc4-30e7-469e-95f1-060a6db1c5af tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:33.978981 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-72e56bc4-30e7-469e-95f1-060a6db1c5af tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.978981 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-72e56bc4-30e7-469e-95f1-060a6db1c5af tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:33.979802 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-72e56bc4-30e7-469e-95f1-060a6db1c5af tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:33.980242 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-72e56bc4-30e7-469e-95f1-060a6db1c5af tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:34.178164 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-72e56bc4-30e7-469e-95f1-060a6db1c5af tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:34.185046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-f399547b-366b-4694-ae81-ef33febbf131 req-da48909c-1a50-43ec-a6ef-ef76248016d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52c67b1-7116-43ef-be38-0f7c6acc677f", "name": "network-vif-plugged", "status": "completed", "tag": "ac66ed7d-031b-4b52-a7dd-034845cce439"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:34.190656 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-72e56bc4-30e7-469e-95f1-060a6db1c5af tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.239616 Jul 14 14:31:34.191444 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 75/136] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:33 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:34.195089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-f399547b-366b-4694-ae81-ef33febbf131 req-da48909c-1a50-43ec-a6ef-ef76248016d1 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:34.196278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-f399547b-366b-4694-ae81-ef33febbf131 req-da48909c-1a50-43ec-a6ef-ef76248016d1 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:34.208954 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-f399547b-366b-4694-ae81-ef33febbf131 req-da48909c-1a50-43ec-a6ef-ef76248016d1 service nova] Creating event network-vif-plugged:ac66ed7d-031b-4b52-a7dd-034845cce439 for instance f52c67b1-7116-43ef-be38-0f7c6acc677f on hv-cinder-79987 Jul 14 14:31:34.217979 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-f399547b-366b-4694-ae81-ef33febbf131 req-da48909c-1a50-43ec-a6ef-ef76248016d1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.309040 Jul 14 14:31:34.218689 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 62/137] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:34.926462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4f3ca6d2-417b-482b-9dd9-3fe2d1f8ac89 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:34.928154 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-4f3ca6d2-417b-482b-9dd9-3fe2d1f8ac89 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:34.941674 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f3ca6d2-417b-482b-9dd9-3fe2d1f8ac89 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:34.942746 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f3ca6d2-417b-482b-9dd9-3fe2d1f8ac89 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:34.944367 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f3ca6d2-417b-482b-9dd9-3fe2d1f8ac89 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:34.945808 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f3ca6d2-417b-482b-9dd9-3fe2d1f8ac89 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:34.970229 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c9775dfe-3f77-474d-99b3-c406213b36e4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:34.971505 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c9775dfe-3f77-474d-99b3-c406213b36e4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:34.982680 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c9775dfe-3f77-474d-99b3-c406213b36e4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:34.987169 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c9775dfe-3f77-474d-99b3-c406213b36e4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:34.988286 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c9775dfe-3f77-474d-99b3-c406213b36e4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:34.988930 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c9775dfe-3f77-474d-99b3-c406213b36e4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:35.260589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4f3ca6d2-417b-482b-9dd9-3fe2d1f8ac89 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:35.268095 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-c9775dfe-3f77-474d-99b3-c406213b36e4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:35.274218 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4f3ca6d2-417b-482b-9dd9-3fe2d1f8ac89 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.350924 Jul 14 14:31:35.276014 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 76/138] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:34 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:35.278949 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c9775dfe-3f77-474d-99b3-c406213b36e4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.313373 Jul 14 14:31:35.279596 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 63/139] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:34 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:35.289896 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0d76ff90-c702-489c-946b-828be6b35201 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:35.289896 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-0d76ff90-c702-489c-946b-828be6b35201 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:35.297179 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0d76ff90-c702-489c-946b-828be6b35201 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:35.297443 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0d76ff90-c702-489c-946b-828be6b35201 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:35.298428 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0d76ff90-c702-489c-946b-828be6b35201 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:35.299668 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0d76ff90-c702-489c-946b-828be6b35201 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:35.492911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-0d76ff90-c702-489c-946b-828be6b35201 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:35.501616 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-0d76ff90-c702-489c-946b-828be6b35201 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.224092 Jul 14 14:31:35.502222 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 77/140] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:35 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:36.240889 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-f4f485fc-423f-4700-89cf-1370518934a9 req-d26a3e82-167d-4bd8-8b0a-e123ff4b9a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99e8a14-f8ad-4237-9381-1f5453bca4b9", "name": "network-vif-plugged", "status": "completed", "tag": "0a7c99e8-4400-4d54-9c86-5fe83dfe11b4"}, {"server_uuid": "af404add-060a-4a34-ba63-b1df4171f2f2", "name": "network-vif-plugged", "status": "completed", "tag": "0e4102af-1b96-490a-9640-00a73098d3cf"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:36.253537 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-f4f485fc-423f-4700-89cf-1370518934a9 req-d26a3e82-167d-4bd8-8b0a-e123ff4b9a21 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:36.254431 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-f4f485fc-423f-4700-89cf-1370518934a9 req-d26a3e82-167d-4bd8-8b0a-e123ff4b9a21 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:36.271838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-f4f485fc-423f-4700-89cf-1370518934a9 req-d26a3e82-167d-4bd8-8b0a-e123ff4b9a21 service nova] Creating event network-vif-plugged:0a7c99e8-4400-4d54-9c86-5fe83dfe11b4 for instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 on hv-cinder-79987 Jul 14 14:31:36.272339 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-f4f485fc-423f-4700-89cf-1370518934a9 req-d26a3e82-167d-4bd8-8b0a-e123ff4b9a21 service nova] Creating event network-vif-plugged:0e4102af-1b96-490a-9640-00a73098d3cf for instance af404add-060a-4a34-ba63-b1df4171f2f2 on hv-cinder-79987 Jul 14 14:31:36.279114 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-f4f485fc-423f-4700-89cf-1370518934a9 req-d26a3e82-167d-4bd8-8b0a-e123ff4b9a21 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042052 Jul 14 14:31:36.280080 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 64/141] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:36.301355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-42651200-f5e6-4bb8-87ed-fff41d8377d5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:36.302082 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-42651200-f5e6-4bb8-87ed-fff41d8377d5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:36.312760 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-42651200-f5e6-4bb8-87ed-fff41d8377d5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:36.314106 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-42651200-f5e6-4bb8-87ed-fff41d8377d5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:36.318312 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-42651200-f5e6-4bb8-87ed-fff41d8377d5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:36.318312 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-42651200-f5e6-4bb8-87ed-fff41d8377d5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:36.324794 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-6f902fe5-d36a-4c20-b8f5-d20e69d9b533 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:36.325648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-6f902fe5-d36a-4c20-b8f5-d20e69d9b533 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:36.336428 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6f902fe5-d36a-4c20-b8f5-d20e69d9b533 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:36.336870 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6f902fe5-d36a-4c20-b8f5-d20e69d9b533 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:36.337662 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6f902fe5-d36a-4c20-b8f5-d20e69d9b533 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:36.338652 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6f902fe5-d36a-4c20-b8f5-d20e69d9b533 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:36.590790 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-42651200-f5e6-4bb8-87ed-fff41d8377d5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:36.604117 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-42651200-f5e6-4bb8-87ed-fff41d8377d5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1320 microversion: 2.1 time: 0.309005 Jul 14 14:31:36.606838 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 78/142] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:36 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1320 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:36.624038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f0ffb8f4-de12-49bb-9d38-4da9f37ac90f tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:36.626734 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-6f902fe5-d36a-4c20-b8f5-d20e69d9b533 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:36.636877 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-f0ffb8f4-de12-49bb-9d38-4da9f37ac90f tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:36.638611 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-6f902fe5-d36a-4c20-b8f5-d20e69d9b533 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.325663 Jul 14 14:31:36.641722 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 65/143] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:36 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:36.644052 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f0ffb8f4-de12-49bb-9d38-4da9f37ac90f tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:36.644741 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f0ffb8f4-de12-49bb-9d38-4da9f37ac90f tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:36.645758 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f0ffb8f4-de12-49bb-9d38-4da9f37ac90f tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:36.646319 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f0ffb8f4-de12-49bb-9d38-4da9f37ac90f tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:36.812402 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-f0ffb8f4-de12-49bb-9d38-4da9f37ac90f tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:36.830243 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-f0ffb8f4-de12-49bb-9d38-4da9f37ac90f tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.218735 Jul 14 14:31:36.836148 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 79/144] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:36 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:37.623453 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-1ba97270-e9e1-4b4f-862a-e0f452cdd347 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:37.624053 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-1ba97270-e9e1-4b4f-862a-e0f452cdd347 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:37.630433 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1ba97270-e9e1-4b4f-862a-e0f452cdd347 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:37.631122 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1ba97270-e9e1-4b4f-862a-e0f452cdd347 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:37.631895 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1ba97270-e9e1-4b4f-862a-e0f452cdd347 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:37.632327 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1ba97270-e9e1-4b4f-862a-e0f452cdd347 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:37.655163 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-83a6d2d3-f2a9-4966-a2a2-cd36694b645f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:37.655776 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-83a6d2d3-f2a9-4966-a2a2-cd36694b645f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:37.662121 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-83a6d2d3-f2a9-4966-a2a2-cd36694b645f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:37.662849 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-83a6d2d3-f2a9-4966-a2a2-cd36694b645f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:37.663809 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-83a6d2d3-f2a9-4966-a2a2-cd36694b645f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:37.664492 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-83a6d2d3-f2a9-4966-a2a2-cd36694b645f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:37.825500 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-1ba97270-e9e1-4b4f-862a-e0f452cdd347 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:37.833276 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-1ba97270-e9e1-4b4f-862a-e0f452cdd347 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1514 microversion: 2.1 time: 0.213581 Jul 14 14:31:37.834005 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 66/145] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:37 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1514 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:37.851233 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-83a6d2d3-f2a9-4966-a2a2-cd36694b645f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:37.853443 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-eda72a18-e963-4972-8beb-1249fb6b813e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:37.861797 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-83a6d2d3-f2a9-4966-a2a2-cd36694b645f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.210230 Jul 14 14:31:37.864077 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 80/146] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:37 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:37.874141 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-eda72a18-e963-4972-8beb-1249fb6b813e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:37.875491 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-eda72a18-e963-4972-8beb-1249fb6b813e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:37.876023 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-eda72a18-e963-4972-8beb-1249fb6b813e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:37.876971 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-eda72a18-e963-4972-8beb-1249fb6b813e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:37.877496 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-eda72a18-e963-4972-8beb-1249fb6b813e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:37.879486 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-8864e7b0-d563-40de-8e11-4ac705929bce tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:37.880348 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-8864e7b0-d563-40de-8e11-4ac705929bce tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:37.901501 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8864e7b0-d563-40de-8e11-4ac705929bce tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:37.902161 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8864e7b0-d563-40de-8e11-4ac705929bce tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:37.904883 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8864e7b0-d563-40de-8e11-4ac705929bce tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:37.907050 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8864e7b0-d563-40de-8e11-4ac705929bce tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:37.961644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-eda72a18-e963-4972-8beb-1249fb6b813e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lazy-loading 'flavor' on Instance uuid f52c67b1-7116-43ef-be38-0f7c6acc677f {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:31:37.970451 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=100 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:38.143033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-8864e7b0-d563-40de-8e11-4ac705929bce tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:38.152946 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-8864e7b0-d563-40de-8e11-4ac705929bce tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1315 microversion: 2.1 time: 0.287279 Jul 14 14:31:38.154073 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 81/147] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:37 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:38.301955 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-89c182f2-4d17-428d-b422-5de6bc3efaa1 req-406fbd7d-4f37-4b89-af6a-48069a4a1225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e8bc61-9b48-4f75-b6cf-c0c05b28aad0", "name": "network-vif-plugged", "status": "completed", "tag": "8ef3b15c-bd64-4c1c-8a46-268bb86b551d"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:38.311268 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-89c182f2-4d17-428d-b422-5de6bc3efaa1 req-406fbd7d-4f37-4b89-af6a-48069a4a1225 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:38.311832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-89c182f2-4d17-428d-b422-5de6bc3efaa1 req-406fbd7d-4f37-4b89-af6a-48069a4a1225 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:38.323515 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-89c182f2-4d17-428d-b422-5de6bc3efaa1 req-406fbd7d-4f37-4b89-af6a-48069a4a1225 service nova] Creating event network-vif-plugged:8ef3b15c-bd64-4c1c-8a46-268bb86b551d for instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 on hv-cinder-79987 Jul 14 14:31:38.328438 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-89c182f2-4d17-428d-b422-5de6bc3efaa1 req-406fbd7d-4f37-4b89-af6a-48069a4a1225 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032844 Jul 14 14:31:38.329066 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 82/148] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:31:38.526110 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-eda72a18-e963-4972-8beb-1249fb6b813e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "POST /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f/action" status: 200 len: 32 microversion: 2.1 time: 0.679199 Jul 14 14:31:38.527036 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 67/149] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 14 14:31:37 2022] POST /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f/action => generated 32 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 14:31:38.536138 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-3bbbe333-ff06-4043-806b-e6da95e2375e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:38.536876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-3bbbe333-ff06-4043-806b-e6da95e2375e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:38.544287 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3bbbe333-ff06-4043-806b-e6da95e2375e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:38.545006 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3bbbe333-ff06-4043-806b-e6da95e2375e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:38.546525 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3bbbe333-ff06-4043-806b-e6da95e2375e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:38.547135 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3bbbe333-ff06-4043-806b-e6da95e2375e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:38.723660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3bbbe333-ff06-4043-806b-e6da95e2375e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:38.734123 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-3bbbe333-ff06-4043-806b-e6da95e2375e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.202093 Jul 14 14:31:38.734863 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 83/150] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:38 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:38.882839 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-3894bd0d-f7f7-47b5-b4b2-9f80afc7eb54 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:38.883634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-3894bd0d-f7f7-47b5-b4b2-9f80afc7eb54 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:38.890516 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3894bd0d-f7f7-47b5-b4b2-9f80afc7eb54 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:38.890969 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3894bd0d-f7f7-47b5-b4b2-9f80afc7eb54 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:38.891804 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3894bd0d-f7f7-47b5-b4b2-9f80afc7eb54 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:38.892240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3894bd0d-f7f7-47b5-b4b2-9f80afc7eb54 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:39.058322 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-3894bd0d-f7f7-47b5-b4b2-9f80afc7eb54 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:39.071418 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-3894bd0d-f7f7-47b5-b4b2-9f80afc7eb54 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.192628 Jul 14 14:31:39.072565 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 68/151] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:38 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:39.170631 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-5f5893e7-3fe9-42f7-8307-beeb1da005a0 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:39.171496 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-5f5893e7-3fe9-42f7-8307-beeb1da005a0 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:39.177662 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5f5893e7-3fe9-42f7-8307-beeb1da005a0 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:39.178145 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5f5893e7-3fe9-42f7-8307-beeb1da005a0 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:39.178899 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5f5893e7-3fe9-42f7-8307-beeb1da005a0 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:39.179320 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5f5893e7-3fe9-42f7-8307-beeb1da005a0 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:39.314895 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5f5893e7-3fe9-42f7-8307-beeb1da005a0 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:39.322948 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-5f5893e7-3fe9-42f7-8307-beeb1da005a0 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1503 microversion: 2.1 time: 0.156373 Jul 14 14:31:39.323617 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 84/152] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:39 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:39.753179 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-21dd56fb-cb90-47e5-8b49-c44fd0099da4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:39.753942 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-21dd56fb-cb90-47e5-8b49-c44fd0099da4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:39.765955 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-21dd56fb-cb90-47e5-8b49-c44fd0099da4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:39.766402 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-21dd56fb-cb90-47e5-8b49-c44fd0099da4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:39.767168 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-21dd56fb-cb90-47e5-8b49-c44fd0099da4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:39.767620 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-21dd56fb-cb90-47e5-8b49-c44fd0099da4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:39.987056 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-21dd56fb-cb90-47e5-8b49-c44fd0099da4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:39.997595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-21dd56fb-cb90-47e5-8b49-c44fd0099da4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.248342 Jul 14 14:31:39.999718 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 69/153] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:39 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:40.091175 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-462b733f-6c4f-4e6e-bca9-abb7cf07b473 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:40.092399 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-462b733f-6c4f-4e6e-bca9-abb7cf07b473 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:40.100540 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-462b733f-6c4f-4e6e-bca9-abb7cf07b473 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:40.101209 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-462b733f-6c4f-4e6e-bca9-abb7cf07b473 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:40.102175 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-462b733f-6c4f-4e6e-bca9-abb7cf07b473 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:40.102824 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-462b733f-6c4f-4e6e-bca9-abb7cf07b473 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:40.245958 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-462b733f-6c4f-4e6e-bca9-abb7cf07b473 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:40.253421 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-462b733f-6c4f-4e6e-bca9-abb7cf07b473 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.167808 Jul 14 14:31:40.254075 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 85/154] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:40 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:41.016221 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-4376efcc-2b22-41c7-b4d8-713a84983702 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:41.016930 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-4376efcc-2b22-41c7-b4d8-713a84983702 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:41.023452 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4376efcc-2b22-41c7-b4d8-713a84983702 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:41.023894 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4376efcc-2b22-41c7-b4d8-713a84983702 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:41.025587 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4376efcc-2b22-41c7-b4d8-713a84983702 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:41.026038 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4376efcc-2b22-41c7-b4d8-713a84983702 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:41.180282 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-4376efcc-2b22-41c7-b4d8-713a84983702 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:41.188721 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-4376efcc-2b22-41c7-b4d8-713a84983702 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.176205 Jul 14 14:31:41.189293 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 70/155] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:41 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:41.271165 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-da3d62f4-7e42-4a24-be35-8c268ac48532 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:41.271767 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-da3d62f4-7e42-4a24-be35-8c268ac48532 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:41.278209 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-da3d62f4-7e42-4a24-be35-8c268ac48532 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:41.278655 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-da3d62f4-7e42-4a24-be35-8c268ac48532 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:41.279404 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-da3d62f4-7e42-4a24-be35-8c268ac48532 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:41.279828 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-da3d62f4-7e42-4a24-be35-8c268ac48532 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:41.428456 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-da3d62f4-7e42-4a24-be35-8c268ac48532 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:41.430088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-da3d62f4-7e42-4a24-be35-8c268ac48532 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1363 microversion: 2.1 time: 0.162577 Jul 14 14:31:41.430745 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 86/156] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:41 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:42.206743 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-bed02a56-f5b3-4a02-b9ea-bd92707eee4d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:42.208084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-bed02a56-f5b3-4a02-b9ea-bd92707eee4d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:42.230667 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bed02a56-f5b3-4a02-b9ea-bd92707eee4d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.231605 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bed02a56-f5b3-4a02-b9ea-bd92707eee4d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.232388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bed02a56-f5b3-4a02-b9ea-bd92707eee4d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.232823 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bed02a56-f5b3-4a02-b9ea-bd92707eee4d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.335206 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-9eacaa72-a5c1-47ab-b781-e2f7314456a6 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbd224c5-223d-447b-baee-5c155fde668b"}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:42.338565 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-9eacaa72-a5c1-47ab-b781-e2f7314456a6 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:42.344770 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9eacaa72-a5c1-47ab-b781-e2f7314456a6 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.345220 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9eacaa72-a5c1-47ab-b781-e2f7314456a6 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.346118 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9eacaa72-a5c1-47ab-b781-e2f7314456a6 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.346750 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9eacaa72-a5c1-47ab-b781-e2f7314456a6 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.408714 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-bed02a56-f5b3-4a02-b9ea-bd92707eee4d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:42.416958 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-bed02a56-f5b3-4a02-b9ea-bd92707eee4d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.214817 Jul 14 14:31:42.421689 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 71/157] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:42 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:42.448318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-45172d8a-4e77-4d1c-8d87-a2d33610a447 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:42.454658 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-45172d8a-4e77-4d1c-8d87-a2d33610a447 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:42.468717 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-45172d8a-4e77-4d1c-8d87-a2d33610a447 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.471888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-45172d8a-4e77-4d1c-8d87-a2d33610a447 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.473476 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-45172d8a-4e77-4d1c-8d87-a2d33610a447 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.474964 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-45172d8a-4e77-4d1c-8d87-a2d33610a447 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.484343 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:42.664449 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-45172d8a-4e77-4d1c-8d87-a2d33610a447 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:42.672092 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-45172d8a-4e77-4d1c-8d87-a2d33610a447 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1549 microversion: 2.1 time: 0.229275 Jul 14 14:31:42.672752 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 72/158] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:42 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1549 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:42.689778 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0982b566-687c-4454-9ebe-ece6c4c55dda tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:42.690392 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0982b566-687c-4454-9ebe-ece6c4c55dda tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:42.696375 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0982b566-687c-4454-9ebe-ece6c4c55dda tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.697453 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0982b566-687c-4454-9ebe-ece6c4c55dda tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.698267 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0982b566-687c-4454-9ebe-ece6c4c55dda tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:42.698699 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0982b566-687c-4454-9ebe-ece6c4c55dda tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:42.778045 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0982b566-687c-4454-9ebe-ece6c4c55dda tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092231 Jul 14 14:31:42.778638 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 73/159] 10.222.0.93 () {58 vars in 1274 bytes} [Thu Jul 14 14:31:42 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:31:43.436742 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0946a8cd-459b-4103-83f8-bb2d90a11da6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:43.438149 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0946a8cd-459b-4103-83f8-bb2d90a11da6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:43.446129 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0946a8cd-459b-4103-83f8-bb2d90a11da6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:43.447578 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0946a8cd-459b-4103-83f8-bb2d90a11da6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:43.448525 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0946a8cd-459b-4103-83f8-bb2d90a11da6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:43.449115 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0946a8cd-459b-4103-83f8-bb2d90a11da6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:43.609805 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-0946a8cd-459b-4103-83f8-bb2d90a11da6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:43.617507 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0946a8cd-459b-4103-83f8-bb2d90a11da6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.185141 Jul 14 14:31:43.619053 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 74/160] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:43 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:43.712701 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-9eacaa72-a5c1-47ab-b781-e2f7314456a6 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "POST /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.381729 Jul 14 14:31:43.726466 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 87/161] 10.222.0.93 () {60 vars in 1322 bytes} [Thu Jul 14 14:31:42 2022] POST /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9/os-volume_attachments => generated 194 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:31:44.635484 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a3ad921f-ff98-4453-818e-3ddac27c0a76 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:44.636142 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a3ad921f-ff98-4453-818e-3ddac27c0a76 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:44.645426 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a3ad921f-ff98-4453-818e-3ddac27c0a76 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:44.646324 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a3ad921f-ff98-4453-818e-3ddac27c0a76 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:44.647650 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a3ad921f-ff98-4453-818e-3ddac27c0a76 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:44.648170 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a3ad921f-ff98-4453-818e-3ddac27c0a76 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:44.815512 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a3ad921f-ff98-4453-818e-3ddac27c0a76 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:44.823820 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a3ad921f-ff98-4453-818e-3ddac27c0a76 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.192706 Jul 14 14:31:44.833414 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 75/162] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:44 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:44.964258 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-ce89052a-0699-4d17-b3ad-e21592edf242 req-89a63348-4ce7-43b9-95e6-1eeeca708b9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43e8bc61-9b48-4f75-b6cf-c0c05b28aad0", "tag": "8ef3b15c-bd64-4c1c-8a46-268bb86b551d"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:44.977714 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-ce89052a-0699-4d17-b3ad-e21592edf242 req-89a63348-4ce7-43b9-95e6-1eeeca708b9f service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:44.979090 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-ce89052a-0699-4d17-b3ad-e21592edf242 req-89a63348-4ce7-43b9-95e6-1eeeca708b9f service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:44.997520 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-ce89052a-0699-4d17-b3ad-e21592edf242 req-89a63348-4ce7-43b9-95e6-1eeeca708b9f service nova] Creating event network-changed:8ef3b15c-bd64-4c1c-8a46-268bb86b551d for instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 on hv-cinder-79987 Jul 14 14:31:45.005354 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-ce89052a-0699-4d17-b3ad-e21592edf242 req-89a63348-4ce7-43b9-95e6-1eeeca708b9f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048552 Jul 14 14:31:45.006777 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 88/163] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:45.850375 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ec6df385-86a4-4d51-a1a8-07ede96b06a3 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:45.851012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ec6df385-86a4-4d51-a1a8-07ede96b06a3 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:45.858732 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ec6df385-86a4-4d51-a1a8-07ede96b06a3 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:45.859528 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ec6df385-86a4-4d51-a1a8-07ede96b06a3 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:45.860296 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ec6df385-86a4-4d51-a1a8-07ede96b06a3 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:45.860786 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ec6df385-86a4-4d51-a1a8-07ede96b06a3 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:46.031063 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ec6df385-86a4-4d51-a1a8-07ede96b06a3 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:46.044466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ec6df385-86a4-4d51-a1a8-07ede96b06a3 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.197755 Jul 14 14:31:46.045513 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 76/164] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:45 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:47.064321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f0fb0de5-c129-4de3-b88b-51427844cc53 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:47.065601 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-f0fb0de5-c129-4de3-b88b-51427844cc53 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:47.072322 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f0fb0de5-c129-4de3-b88b-51427844cc53 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:47.072769 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f0fb0de5-c129-4de3-b88b-51427844cc53 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:47.073553 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f0fb0de5-c129-4de3-b88b-51427844cc53 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:47.074073 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f0fb0de5-c129-4de3-b88b-51427844cc53 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:47.219180 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-f0fb0de5-c129-4de3-b88b-51427844cc53 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:47.226911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-f0fb0de5-c129-4de3-b88b-51427844cc53 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.166832 Jul 14 14:31:47.227486 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 89/165] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:47 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:48.247563 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-66e46376-64c1-4c86-8846-dec94edb5144 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:48.248194 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-66e46376-64c1-4c86-8846-dec94edb5144 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:48.250594 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=75 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:48.255454 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-66e46376-64c1-4c86-8846-dec94edb5144 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:48.255839 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-66e46376-64c1-4c86-8846-dec94edb5144 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:48.256603 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-66e46376-64c1-4c86-8846-dec94edb5144 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:48.257020 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-66e46376-64c1-4c86-8846-dec94edb5144 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:48.430905 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-66e46376-64c1-4c86-8846-dec94edb5144 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:48.439594 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-66e46376-64c1-4c86-8846-dec94edb5144 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.195786 Jul 14 14:31:48.441848 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 77/166] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:48 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:49.464879 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-40a392cc-f1fa-4941-bf41-5bfd9b7d19a4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:49.465481 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-40a392cc-f1fa-4941-bf41-5bfd9b7d19a4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:49.467953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=76 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:49.472718 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-40a392cc-f1fa-4941-bf41-5bfd9b7d19a4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:49.473156 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-40a392cc-f1fa-4941-bf41-5bfd9b7d19a4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:49.473928 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-40a392cc-f1fa-4941-bf41-5bfd9b7d19a4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:49.474456 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-40a392cc-f1fa-4941-bf41-5bfd9b7d19a4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:49.741018 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-40a392cc-f1fa-4941-bf41-5bfd9b7d19a4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:49.741018 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-40a392cc-f1fa-4941-bf41-5bfd9b7d19a4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.165209 Jul 14 14:31:49.741018 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 90/167] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:49 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:50.644494 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-3b5a3a10-d87e-4a86-be48-8f4b246e9823 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:50.645248 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-3b5a3a10-d87e-4a86-be48-8f4b246e9823 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:50.651432 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3b5a3a10-d87e-4a86-be48-8f4b246e9823 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:50.651906 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3b5a3a10-d87e-4a86-be48-8f4b246e9823 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:50.652877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3b5a3a10-d87e-4a86-be48-8f4b246e9823 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:50.653332 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3b5a3a10-d87e-4a86-be48-8f4b246e9823 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:50.788861 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-3b5a3a10-d87e-4a86-be48-8f4b246e9823 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:50.796891 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-3b5a3a10-d87e-4a86-be48-8f4b246e9823 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.156916 Jul 14 14:31:50.797760 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 78/168] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:50 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:51.814602 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-9ad95543-6162-441d-910b-fcc34e363139 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:51.815400 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-9ad95543-6162-441d-910b-fcc34e363139 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:51.823156 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9ad95543-6162-441d-910b-fcc34e363139 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:51.823867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9ad95543-6162-441d-910b-fcc34e363139 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:51.824656 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9ad95543-6162-441d-910b-fcc34e363139 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:51.825234 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9ad95543-6162-441d-910b-fcc34e363139 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:52.033457 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-9ad95543-6162-441d-910b-fcc34e363139 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:52.047557 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-9ad95543-6162-441d-910b-fcc34e363139 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.237462 Jul 14 14:31:52.049006 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 91/169] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:51 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:53.067357 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-949eea21-91a1-4415-af17-132f71b6e1cd tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:53.067956 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-949eea21-91a1-4415-af17-132f71b6e1cd tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:53.080973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-949eea21-91a1-4415-af17-132f71b6e1cd tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:53.082580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-949eea21-91a1-4415-af17-132f71b6e1cd tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:53.084294 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-949eea21-91a1-4415-af17-132f71b6e1cd tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:53.085389 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-949eea21-91a1-4415-af17-132f71b6e1cd tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:53.283510 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-949eea21-91a1-4415-af17-132f71b6e1cd tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:53.292043 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-949eea21-91a1-4415-af17-132f71b6e1cd tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.229596 Jul 14 14:31:53.292616 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 79/170] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:53 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:53.669792 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f236e279-d99d-4d92-adaa-0d791c506e90 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:53.670315 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-f236e279-d99d-4d92-adaa-0d791c506e90 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:53.677095 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f236e279-d99d-4d92-adaa-0d791c506e90 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:53.677395 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f236e279-d99d-4d92-adaa-0d791c506e90 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:53.678121 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f236e279-d99d-4d92-adaa-0d791c506e90 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:53.678552 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f236e279-d99d-4d92-adaa-0d791c506e90 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:53.709267 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-f236e279-d99d-4d92-adaa-0d791c506e90 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Going to try to terminate instance {{(pid=118461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:31:54.139291 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-f236e279-d99d-4d92-adaa-0d791c506e90 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 204 len: 0 microversion: 2.1 time: 0.473061 Jul 14 14:31:54.139889 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 92/171] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:31:53 2022] DELETE /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:31:54.148435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-693a3fbe-f6b5-45fa-bfa7-848e51649330 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:54.154479 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-693a3fbe-f6b5-45fa-bfa7-848e51649330 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:54.159369 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-693a3fbe-f6b5-45fa-bfa7-848e51649330 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:54.159877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-693a3fbe-f6b5-45fa-bfa7-848e51649330 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:54.160639 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-693a3fbe-f6b5-45fa-bfa7-848e51649330 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:54.161359 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-693a3fbe-f6b5-45fa-bfa7-848e51649330 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:54.304052 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-693a3fbe-f6b5-45fa-bfa7-848e51649330 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:54.313421 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-12fb6bef-df36-4036-906f-eb4de1ea91b8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:54.314185 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-12fb6bef-df36-4036-906f-eb4de1ea91b8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:54.314541 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-693a3fbe-f6b5-45fa-bfa7-848e51649330 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1555 microversion: 2.1 time: 0.169757 Jul 14 14:31:54.315649 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 80/172] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:54 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:54.321740 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-12fb6bef-df36-4036-906f-eb4de1ea91b8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:54.322228 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-12fb6bef-df36-4036-906f-eb4de1ea91b8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:54.323160 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-12fb6bef-df36-4036-906f-eb4de1ea91b8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:54.323590 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-12fb6bef-df36-4036-906f-eb4de1ea91b8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:54.461359 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-12fb6bef-df36-4036-906f-eb4de1ea91b8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:54.469927 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-12fb6bef-df36-4036-906f-eb4de1ea91b8 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.165028 Jul 14 14:31:54.470485 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 93/173] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:54 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:55.332533 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-fa5500db-ee11-46a1-833c-0ee384791638 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:55.332533 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-fa5500db-ee11-46a1-833c-0ee384791638 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:55.338832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fa5500db-ee11-46a1-833c-0ee384791638 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:55.346342 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fa5500db-ee11-46a1-833c-0ee384791638 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:55.346342 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fa5500db-ee11-46a1-833c-0ee384791638 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:55.346342 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fa5500db-ee11-46a1-833c-0ee384791638 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:55.487282 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-fa5500db-ee11-46a1-833c-0ee384791638 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:55.493885 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-6987211f-f14a-4f3b-b20a-131470431107 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:55.495003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-6987211f-f14a-4f3b-b20a-131470431107 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:55.497143 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-fa5500db-ee11-46a1-833c-0ee384791638 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1555 microversion: 2.1 time: 0.169166 Jul 14 14:31:55.497938 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 81/174] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:55 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:55.502648 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6987211f-f14a-4f3b-b20a-131470431107 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:55.503089 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6987211f-f14a-4f3b-b20a-131470431107 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:55.503849 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6987211f-f14a-4f3b-b20a-131470431107 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:55.504337 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6987211f-f14a-4f3b-b20a-131470431107 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:55.668479 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-6987211f-f14a-4f3b-b20a-131470431107 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:55.676330 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-6987211f-f14a-4f3b-b20a-131470431107 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.193612 Jul 14 14:31:55.677837 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 94/175] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:55 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:56.515171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f4a1fb87-8ddc-4930-873a-0800688ecb6a tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:56.515874 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f4a1fb87-8ddc-4930-873a-0800688ecb6a tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:56.526814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f4a1fb87-8ddc-4930-873a-0800688ecb6a tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:56.527258 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f4a1fb87-8ddc-4930-873a-0800688ecb6a tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:56.528206 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f4a1fb87-8ddc-4930-873a-0800688ecb6a tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:56.528820 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f4a1fb87-8ddc-4930-873a-0800688ecb6a tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:56.694846 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d23f3f35-9da5-434a-bd8b-e51abc008967 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:56.695496 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d23f3f35-9da5-434a-bd8b-e51abc008967 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:56.704075 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d23f3f35-9da5-434a-bd8b-e51abc008967 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:56.709051 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d23f3f35-9da5-434a-bd8b-e51abc008967 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:56.709051 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d23f3f35-9da5-434a-bd8b-e51abc008967 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:56.709051 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d23f3f35-9da5-434a-bd8b-e51abc008967 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:56.753712 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f4a1fb87-8ddc-4930-873a-0800688ecb6a tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:56.762160 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f4a1fb87-8ddc-4930-873a-0800688ecb6a tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1555 microversion: 2.1 time: 0.250827 Jul 14 14:31:56.762958 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 82/176] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:56 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1555 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:56.889704 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d23f3f35-9da5-434a-bd8b-e51abc008967 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:56.908733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d23f3f35-9da5-434a-bd8b-e51abc008967 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.217526 Jul 14 14:31:56.909593 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 95/177] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:56 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:31:56.934949 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-50405591-722a-4e5f-9ae2-274a7e99ce4e req-5cfbcf72-34d5-4805-9e9e-28bb897645f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99e8a14-f8ad-4237-9381-1f5453bca4b9", "name": "network-vif-deleted", "tag": "0a7c99e8-4400-4d54-9c86-5fe83dfe11b4"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:31:56.951748 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-50405591-722a-4e5f-9ae2-274a7e99ce4e req-5cfbcf72-34d5-4805-9e9e-28bb897645f8 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:56.952192 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-50405591-722a-4e5f-9ae2-274a7e99ce4e req-5cfbcf72-34d5-4805-9e9e-28bb897645f8 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:56.964307 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-50405591-722a-4e5f-9ae2-274a7e99ce4e req-5cfbcf72-34d5-4805-9e9e-28bb897645f8 service nova] Creating event network-vif-deleted:0a7c99e8-4400-4d54-9c86-5fe83dfe11b4 for instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 on hv-cinder-79987 Jul 14 14:31:56.972155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-50405591-722a-4e5f-9ae2-274a7e99ce4e req-5cfbcf72-34d5-4805-9e9e-28bb897645f8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040694 Jul 14 14:31:56.975896 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 83/178] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:31:57.780134 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d52fd26f-a542-470f-9dc0-d391a069627e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:57.781212 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d52fd26f-a542-470f-9dc0-d391a069627e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:57.789641 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d52fd26f-a542-470f-9dc0-d391a069627e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:57.790684 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d52fd26f-a542-470f-9dc0-d391a069627e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:57.791495 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d52fd26f-a542-470f-9dc0-d391a069627e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:57.791953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d52fd26f-a542-470f-9dc0-d391a069627e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:57.810228 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:31:57.824336 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d52fd26f-a542-470f-9dc0-d391a069627e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:57.824965 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d52fd26f-a542-470f-9dc0-d391a069627e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:57.825411 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.objects.instance [None req-d52fd26f-a542-470f-9dc0-d391a069627e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lazy-loading 'fault' on Instance uuid a99e8a14-f8ad-4237-9381-1f5453bca4b9 {{(pid=118461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:31:57.870400 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d52fd26f-a542-470f-9dc0-d391a069627e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2ac3e31fee448d7ae7a6d885f545636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725a19566454345b77b639cfe170008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:57.878435 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d52fd26f-a542-470f-9dc0-d391a069627e tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 200 len: 1351 microversion: 2.1 time: 0.102343 Jul 14 14:31:57.879409 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 96/179] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:57 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:57.928275 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-831a6852-3a47-406c-b233-6290eeeaa724 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:57.929108 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-831a6852-3a47-406c-b233-6290eeeaa724 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:57.937793 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-831a6852-3a47-406c-b233-6290eeeaa724 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:57.938241 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-831a6852-3a47-406c-b233-6290eeeaa724 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:57.939024 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-831a6852-3a47-406c-b233-6290eeeaa724 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:57.939447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-831a6852-3a47-406c-b233-6290eeeaa724 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:58.103573 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-831a6852-3a47-406c-b233-6290eeeaa724 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:58.112391 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-831a6852-3a47-406c-b233-6290eeeaa724 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.188828 Jul 14 14:31:58.113147 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 84/180] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:57 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:31:58.897366 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c87c8f2f-aec4-4ec4-8483-a5161c03ced8 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:58.898070 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c87c8f2f-aec4-4ec4-8483-a5161c03ced8 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:58.905320 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c87c8f2f-aec4-4ec4-8483-a5161c03ced8 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:58.906111 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c87c8f2f-aec4-4ec4-8483-a5161c03ced8 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:58.907067 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c87c8f2f-aec4-4ec4-8483-a5161c03ced8 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:58.907652 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c87c8f2f-aec4-4ec4-8483-a5161c03ced8 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:58.924205 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-c87c8f2f-aec4-4ec4-8483-a5161c03ced8 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] HTTP exception thrown: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c87c8f2f-aec4-4ec4-8483-a5161c03ced8 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Request method failure captured: Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 HTTP/1.1 Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0CiapgCcqCF33tRAvmKPBnWEF9eZZUUM5DEDfC26E2R_yxI-bym31bWMaYyyftqKWTofT6ohiMITYj2e1KWpG5XnM_IZEgGmNDXL8gSMo6jOBzc4XjkgCaNMAU_vMKRJYb04JSREbDL4CGkrcFVXU1oPI8uhcbSIAAt41_re7kljI0I Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: 8725a19566454345b77b639cfe170008 Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-DeleteServersTestJSON-1367776894 Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:31:58.930176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:31:58.931671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8725a19566454345b77b639cfe170008"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8725a19566454345b77b639cfe170008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8725a19566454345b77b639cfe170008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8725a19566454345b77b639cfe170008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:31:58.931671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-DeleteServersTestJSON-1367776894 Jul 14 14:31:58.931671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: 8725a19566454345b77b639cfe170008 Jul 14 14:31:58.931671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1367776894 Jul 14 14:31:58.931671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-DeleteServersTestJSON-1367776894-project Jul 14 14:31:58.931671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:31:58.931671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:31:58.931671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: e2ac3e31fee448d7ae7a6d885f545636 Jul 14 14:31:58.931671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-DeleteServersTestJSON-1367776894-project Jul 14 14:31:58.931671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:31:58.931671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:31:58.931671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': 'a99e8a14-f8ad-4237-9381-1f5453bca4b9'} Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:58.932349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:58.933475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:58.933475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:31:58.933475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:31:58.933475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:31:58.933475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:31:58.933475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:31:58.933475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:31:58.933475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:31:58.933475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:58.933475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:58.933475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:58.933475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:58.933475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:58.933475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:58.933475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:31:58.933475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:31:58.933475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:31:58.933475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:31:58.936957 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c87c8f2f-aec4-4ec4-8483-a5161c03ced8 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Returning 404 to user: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:58.936957 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c87c8f2f-aec4-4ec4-8483-a5161c03ced8 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 404 len: 111 microversion: 2.1 time: 0.038918 Jul 14 14:31:58.936957 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 97/181] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:58 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:31:59.067933 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-96c5b08c-f924-4fe4-9485-bcf35ce035f4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:59.068863 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-96c5b08c-f924-4fe4-9485-bcf35ce035f4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:59.097898 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-96c5b08c-f924-4fe4-9485-bcf35ce035f4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:59.100422 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-96c5b08c-f924-4fe4-9485-bcf35ce035f4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:59.102070 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-96c5b08c-f924-4fe4-9485-bcf35ce035f4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:59.103426 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-96c5b08c-f924-4fe4-9485-bcf35ce035f4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:59.121226 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-96c5b08c-f924-4fe4-9485-bcf35ce035f4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] HTTP exception thrown: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-96c5b08c-f924-4fe4-9485-bcf35ce035f4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Request method failure captured: Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9/os-volume_attachments HTTP/1.1 Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0CiapgCcqCF33tRAvmKPBnWEF9eZZUUM5DEDfC26E2R_yxI-bym31bWMaYyyftqKWTofT6ohiMITYj2e1KWpG5XnM_IZEgGmNDXL8gSMo6jOBzc4XjkgCaNMAU_vMKRJYb04JSREbDL4CGkrcFVXU1oPI8uhcbSIAAt41_re7kljI0I Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: 8725a19566454345b77b639cfe170008 Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-DeleteServersTestJSON-1367776894 Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:31:59.135097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:31:59.136482 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8725a19566454345b77b639cfe170008"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8725a19566454345b77b639cfe170008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8725a19566454345b77b639cfe170008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8725a19566454345b77b639cfe170008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:31:59.136482 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-DeleteServersTestJSON-1367776894 Jul 14 14:31:59.136482 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: 8725a19566454345b77b639cfe170008 Jul 14 14:31:59.136482 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1367776894 Jul 14 14:31:59.136482 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-DeleteServersTestJSON-1367776894-project Jul 14 14:31:59.136482 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:31:59.136482 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:31:59.136482 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: e2ac3e31fee448d7ae7a6d885f545636 Jul 14 14:31:59.136482 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-DeleteServersTestJSON-1367776894-project Jul 14 14:31:59.136482 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:31:59.136482 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:31:59.136482 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'server_id': 'a99e8a14-f8ad-4237-9381-1f5453bca4b9'} Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:31:59.137259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:31:59.138580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:31:59.139886 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-96c5b08c-f924-4fe4-9485-bcf35ce035f4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Returning 404 to user: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:31:59.139886 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-96c5b08c-f924-4fe4-9485-bcf35ce035f4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.068745 Jul 14 14:31:59.139886 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 85/182] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:31:59 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9/os-volume_attachments => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:31:59.140110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-5cb71c7c-3743-4390-9150-6303ef480677 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:31:59.140110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-5cb71c7c-3743-4390-9150-6303ef480677 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:31:59.148334 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5cb71c7c-3743-4390-9150-6303ef480677 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:59.150662 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5cb71c7c-3743-4390-9150-6303ef480677 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:59.151990 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5cb71c7c-3743-4390-9150-6303ef480677 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:31:59.153104 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5cb71c7c-3743-4390-9150-6303ef480677 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:31:59.320863 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5cb71c7c-3743-4390-9150-6303ef480677 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:31:59.330161 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-5cb71c7c-3743-4390-9150-6303ef480677 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.201590 Jul 14 14:31:59.330884 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 98/183] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:31:59 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:00.357530 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-509818b7-cb8d-435b-bf83-7a297cbf62c6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:00.360765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-509818b7-cb8d-435b-bf83-7a297cbf62c6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:00.372340 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-509818b7-cb8d-435b-bf83-7a297cbf62c6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:00.374965 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-509818b7-cb8d-435b-bf83-7a297cbf62c6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:00.376079 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-509818b7-cb8d-435b-bf83-7a297cbf62c6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:00.376701 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-509818b7-cb8d-435b-bf83-7a297cbf62c6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:00.537496 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-509818b7-cb8d-435b-bf83-7a297cbf62c6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:00.545119 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-509818b7-cb8d-435b-bf83-7a297cbf62c6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.199813 Jul 14 14:32:00.546406 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 86/184] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:00 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:00.878695 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0b3da555-c3ec-4e24-9a2a-89092cab26c4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:00.879434 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-0b3da555-c3ec-4e24-9a2a-89092cab26c4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:00.887400 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0b3da555-c3ec-4e24-9a2a-89092cab26c4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:00.887943 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0b3da555-c3ec-4e24-9a2a-89092cab26c4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:00.889305 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0b3da555-c3ec-4e24-9a2a-89092cab26c4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:00.889906 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0b3da555-c3ec-4e24-9a2a-89092cab26c4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:00.908202 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-0b3da555-c3ec-4e24-9a2a-89092cab26c4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] HTTP exception thrown: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0b3da555-c3ec-4e24-9a2a-89092cab26c4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Request method failure captured: Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: DELETE /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 HTTP/1.1 Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0CiapgCcqCF33tRAvmKPBnWEF9eZZUUM5DEDfC26E2R_yxI-bym31bWMaYyyftqKWTofT6ohiMITYj2e1KWpG5XnM_IZEgGmNDXL8gSMo6jOBzc4XjkgCaNMAU_vMKRJYb04JSREbDL4CGkrcFVXU1oPI8uhcbSIAAt41_re7kljI0I Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: 8725a19566454345b77b639cfe170008 Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-DeleteServersTestJSON-1367776894 Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:32:00.910581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:32:00.911975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8725a19566454345b77b639cfe170008"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8725a19566454345b77b639cfe170008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8725a19566454345b77b639cfe170008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8725a19566454345b77b639cfe170008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:32:00.911975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-DeleteServersTestJSON-1367776894 Jul 14 14:32:00.911975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: 8725a19566454345b77b639cfe170008 Jul 14 14:32:00.911975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1367776894 Jul 14 14:32:00.911975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-DeleteServersTestJSON-1367776894-project Jul 14 14:32:00.911975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:32:00.911975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:32:00.911975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: e2ac3e31fee448d7ae7a6d885f545636 Jul 14 14:32:00.911975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-DeleteServersTestJSON-1367776894-project Jul 14 14:32:00.911975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:32:00.911975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:32:00.911975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': 'a99e8a14-f8ad-4237-9381-1f5453bca4b9'} Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:32:00.912639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:32:00.913867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:32:00.916415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0b3da555-c3ec-4e24-9a2a-89092cab26c4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Returning 404 to user: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:32:00.917253 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-0b3da555-c3ec-4e24-9a2a-89092cab26c4 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "DELETE /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 404 len: 111 microversion: 2.1 time: 0.044880 Jul 14 14:32:00.918026 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 99/185] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:32:00 2022] DELETE /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:32:00.926285 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-3d1784c4-bf13-453e-abde-9180b14edb48 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:00.926900 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-3d1784c4-bf13-453e-abde-9180b14edb48 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] [instance: a99e8a14-f8ad-4237-9381-1f5453bca4b9] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:00.935463 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3d1784c4-bf13-453e-abde-9180b14edb48 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:00.935910 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3d1784c4-bf13-453e-abde-9180b14edb48 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:00.936682 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3d1784c4-bf13-453e-abde-9180b14edb48 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:00.937115 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3d1784c4-bf13-453e-abde-9180b14edb48 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:00.957535 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-3d1784c4-bf13-453e-abde-9180b14edb48 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] HTTP exception thrown: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-3d1784c4-bf13-453e-abde-9180b14edb48 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Request method failure captured: Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 HTTP/1.1 Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0CiapgCcqCF33tRAvmKPBnWEF9eZZUUM5DEDfC26E2R_yxI-bym31bWMaYyyftqKWTofT6ohiMITYj2e1KWpG5XnM_IZEgGmNDXL8gSMo6jOBzc4XjkgCaNMAU_vMKRJYb04JSREbDL4CGkrcFVXU1oPI8uhcbSIAAt41_re7kljI0I Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: 8725a19566454345b77b639cfe170008 Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-DeleteServersTestJSON-1367776894 Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:32:00.972877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:32:00.974358 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8725a19566454345b77b639cfe170008"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8725a19566454345b77b639cfe170008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8725a19566454345b77b639cfe170008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8725a19566454345b77b639cfe170008"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:32:00.974358 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-DeleteServersTestJSON-1367776894 Jul 14 14:32:00.974358 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: 8725a19566454345b77b639cfe170008 Jul 14 14:32:00.974358 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1367776894 Jul 14 14:32:00.974358 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-DeleteServersTestJSON-1367776894-project Jul 14 14:32:00.974358 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:32:00.974358 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:32:00.974358 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: e2ac3e31fee448d7ae7a6d885f545636 Jul 14 14:32:00.974358 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-DeleteServersTestJSON-1367776894-project Jul 14 14:32:00.974358 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:32:00.974358 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:32:00.974358 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': 'a99e8a14-f8ad-4237-9381-1f5453bca4b9'} Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:32:00.975144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:32:00.976622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:32:00.976622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:32:00.976622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:32:00.976622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:32:00.976622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:32:00.976622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:32:00.976622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:32:00.976622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:32:00.976622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:32:00.976622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:00.976622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:32:00.976622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:00.976622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:00.976622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:00.976622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:32:00.976622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:32:00.976622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. Jul 14 14:32:00.976622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:32:00.978414 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-3d1784c4-bf13-453e-abde-9180b14edb48 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] Returning 404 to user: Instance a99e8a14-f8ad-4237-9381-1f5453bca4b9 could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:32:00.978414 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-3d1784c4-bf13-453e-abde-9180b14edb48 tempest-DeleteServersTestJSON-1367776894 tempest-DeleteServersTestJSON-1367776894-project] 10.222.0.93 "GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9" status: 404 len: 111 microversion: 2.1 time: 0.051919 Jul 14 14:32:00.989819 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 87/186] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:00 2022] GET /compute/v2.1/servers/a99e8a14-f8ad-4237-9381-1f5453bca4b9 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:32:01.564971 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e829a6e9-4e16-4ea8-8497-a63811769c14 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:01.565651 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e829a6e9-4e16-4ea8-8497-a63811769c14 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:01.574616 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e829a6e9-4e16-4ea8-8497-a63811769c14 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:01.575865 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e829a6e9-4e16-4ea8-8497-a63811769c14 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:01.576647 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e829a6e9-4e16-4ea8-8497-a63811769c14 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:01.577075 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e829a6e9-4e16-4ea8-8497-a63811769c14 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:01.761539 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e829a6e9-4e16-4ea8-8497-a63811769c14 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:01.770452 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e829a6e9-4e16-4ea8-8497-a63811769c14 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.211622 Jul 14 14:32:01.771040 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 100/187] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:01 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:02.788615 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-cf263662-0ab8-4c7d-bcce-7c9966dc083e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:02.789880 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-cf263662-0ab8-4c7d-bcce-7c9966dc083e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:02.798777 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cf263662-0ab8-4c7d-bcce-7c9966dc083e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:02.799479 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cf263662-0ab8-4c7d-bcce-7c9966dc083e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:02.800456 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cf263662-0ab8-4c7d-bcce-7c9966dc083e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:02.801038 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cf263662-0ab8-4c7d-bcce-7c9966dc083e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:03.136821 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-cf263662-0ab8-4c7d-bcce-7c9966dc083e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:03.146401 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-cf263662-0ab8-4c7d-bcce-7c9966dc083e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.362075 Jul 14 14:32:03.149394 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 88/188] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:02 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:04.162652 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-622cb869-89c2-4a8a-8e0b-bbcb33402d8b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:04.163247 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-622cb869-89c2-4a8a-8e0b-bbcb33402d8b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:04.174149 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-622cb869-89c2-4a8a-8e0b-bbcb33402d8b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:04.174696 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-622cb869-89c2-4a8a-8e0b-bbcb33402d8b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:04.175859 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-622cb869-89c2-4a8a-8e0b-bbcb33402d8b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:04.176468 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-622cb869-89c2-4a8a-8e0b-bbcb33402d8b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:04.333163 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-622cb869-89c2-4a8a-8e0b-bbcb33402d8b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:04.343798 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-622cb869-89c2-4a8a-8e0b-bbcb33402d8b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.184741 Jul 14 14:32:04.357483 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 101/189] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:04 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:05.365099 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-83a9d736-93aa-4ebb-98d8-b6c3f7a2e142 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:05.366554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-83a9d736-93aa-4ebb-98d8-b6c3f7a2e142 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:05.375178 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-83a9d736-93aa-4ebb-98d8-b6c3f7a2e142 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:05.375902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-83a9d736-93aa-4ebb-98d8-b6c3f7a2e142 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:05.376987 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-83a9d736-93aa-4ebb-98d8-b6c3f7a2e142 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:05.377565 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-83a9d736-93aa-4ebb-98d8-b6c3f7a2e142 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:05.715815 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-83a9d736-93aa-4ebb-98d8-b6c3f7a2e142 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:05.728318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-83a9d736-93aa-4ebb-98d8-b6c3f7a2e142 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.365864 Jul 14 14:32:05.728937 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 89/190] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:05 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:06.750377 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c66635e6-47f1-4acb-b520-15c1316a5798 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:06.751693 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c66635e6-47f1-4acb-b520-15c1316a5798 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:06.764465 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c66635e6-47f1-4acb-b520-15c1316a5798 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:06.764465 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c66635e6-47f1-4acb-b520-15c1316a5798 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:06.764465 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c66635e6-47f1-4acb-b520-15c1316a5798 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:06.770163 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c66635e6-47f1-4acb-b520-15c1316a5798 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:06.944613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c66635e6-47f1-4acb-b520-15c1316a5798 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:06.952553 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c66635e6-47f1-4acb-b520-15c1316a5798 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.210802 Jul 14 14:32:06.955149 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 102/191] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:06 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:07.972821 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-4e64935b-48b2-4760-afd5-8675afb5f2b7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:07.974074 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-4e64935b-48b2-4760-afd5-8675afb5f2b7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:07.989132 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4e64935b-48b2-4760-afd5-8675afb5f2b7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:07.989960 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4e64935b-48b2-4760-afd5-8675afb5f2b7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:07.990939 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4e64935b-48b2-4760-afd5-8675afb5f2b7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:07.993366 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4e64935b-48b2-4760-afd5-8675afb5f2b7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:08.299885 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-4e64935b-48b2-4760-afd5-8675afb5f2b7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:08.309312 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-4e64935b-48b2-4760-afd5-8675afb5f2b7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.340478 Jul 14 14:32:08.309950 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 90/192] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:07 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:09.327163 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e9f995c7-abda-49fc-b554-1fcdeca2450f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:09.328448 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e9f995c7-abda-49fc-b554-1fcdeca2450f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:09.343541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e9f995c7-abda-49fc-b554-1fcdeca2450f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:09.344242 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e9f995c7-abda-49fc-b554-1fcdeca2450f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:09.351340 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e9f995c7-abda-49fc-b554-1fcdeca2450f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:09.351340 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e9f995c7-abda-49fc-b554-1fcdeca2450f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:09.637979 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e9f995c7-abda-49fc-b554-1fcdeca2450f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:09.651477 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e9f995c7-abda-49fc-b554-1fcdeca2450f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.328691 Jul 14 14:32:09.655134 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 103/193] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:09 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:10.674874 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-db976a01-5082-4467-8d81-3e1845e10880 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:10.674874 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-db976a01-5082-4467-8d81-3e1845e10880 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:10.681450 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-db976a01-5082-4467-8d81-3e1845e10880 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:10.682281 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-db976a01-5082-4467-8d81-3e1845e10880 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:10.683115 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-db976a01-5082-4467-8d81-3e1845e10880 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:10.683739 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-db976a01-5082-4467-8d81-3e1845e10880 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:10.689274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=100 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:10.908099 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-db976a01-5082-4467-8d81-3e1845e10880 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:10.916299 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-db976a01-5082-4467-8d81-3e1845e10880 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.248816 Jul 14 14:32:10.929174 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 91/194] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:10 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:11.951875 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c8fb7c45-ade4-49fe-93e3-1f9a47c35cf5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:11.953105 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c8fb7c45-ade4-49fe-93e3-1f9a47c35cf5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:11.981680 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c8fb7c45-ade4-49fe-93e3-1f9a47c35cf5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:11.982167 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c8fb7c45-ade4-49fe-93e3-1f9a47c35cf5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:11.982942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c8fb7c45-ade4-49fe-93e3-1f9a47c35cf5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:11.983803 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c8fb7c45-ade4-49fe-93e3-1f9a47c35cf5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:12.260748 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c8fb7c45-ade4-49fe-93e3-1f9a47c35cf5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:12.268970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c8fb7c45-ade4-49fe-93e3-1f9a47c35cf5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.327171 Jul 14 14:32:12.270180 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 104/195] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:11 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:13.286856 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-5e09c983-55e1-4876-8535-f18f38b42541 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:13.288010 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-5e09c983-55e1-4876-8535-f18f38b42541 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:13.296948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5e09c983-55e1-4876-8535-f18f38b42541 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:13.297612 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5e09c983-55e1-4876-8535-f18f38b42541 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:13.298637 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5e09c983-55e1-4876-8535-f18f38b42541 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:13.299304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5e09c983-55e1-4876-8535-f18f38b42541 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:13.533662 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-5e09c983-55e1-4876-8535-f18f38b42541 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:13.544599 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-5e09c983-55e1-4876-8535-f18f38b42541 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.261516 Jul 14 14:32:13.555808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 92/196] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:13 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:14.561941 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-99eee1c2-cd08-4cb4-8a78-ac0c527fd8b6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:14.562556 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-99eee1c2-cd08-4cb4-8a78-ac0c527fd8b6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:14.570405 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-99eee1c2-cd08-4cb4-8a78-ac0c527fd8b6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:14.572262 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-99eee1c2-cd08-4cb4-8a78-ac0c527fd8b6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:14.574160 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-99eee1c2-cd08-4cb4-8a78-ac0c527fd8b6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:14.575391 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-99eee1c2-cd08-4cb4-8a78-ac0c527fd8b6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:14.877667 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-99eee1c2-cd08-4cb4-8a78-ac0c527fd8b6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:14.889720 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-99eee1c2-cd08-4cb4-8a78-ac0c527fd8b6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.329792 Jul 14 14:32:14.890810 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 105/197] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:14 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:15.912112 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-8a012356-6250-4bb8-bd99-99ac8d034c2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:15.913406 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-8a012356-6250-4bb8-bd99-99ac8d034c2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:15.923246 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8a012356-6250-4bb8-bd99-99ac8d034c2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:15.925977 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8a012356-6250-4bb8-bd99-99ac8d034c2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:15.925977 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8a012356-6250-4bb8-bd99-99ac8d034c2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:15.927030 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8a012356-6250-4bb8-bd99-99ac8d034c2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:16.412733 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-8a012356-6250-4bb8-bd99-99ac8d034c2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:16.423356 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-8a012356-6250-4bb8-bd99-99ac8d034c2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.515868 Jul 14 14:32:16.425939 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 93/198] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:15 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:17.443913 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c05392b3-c51e-4280-bee9-a3c48415d839 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:17.444624 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c05392b3-c51e-4280-bee9-a3c48415d839 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:17.462469 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c05392b3-c51e-4280-bee9-a3c48415d839 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:17.462937 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c05392b3-c51e-4280-bee9-a3c48415d839 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:17.463752 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c05392b3-c51e-4280-bee9-a3c48415d839 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:17.464204 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c05392b3-c51e-4280-bee9-a3c48415d839 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:17.896533 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c05392b3-c51e-4280-bee9-a3c48415d839 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:17.904211 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c05392b3-c51e-4280-bee9-a3c48415d839 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.467206 Jul 14 14:32:17.904790 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 106/199] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:17 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:18.920884 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-bece55d8-86dd-4254-9457-80e90899934a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:18.924531 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-bece55d8-86dd-4254-9457-80e90899934a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:18.932288 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bece55d8-86dd-4254-9457-80e90899934a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:18.932964 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bece55d8-86dd-4254-9457-80e90899934a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:18.933933 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bece55d8-86dd-4254-9457-80e90899934a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:18.934518 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bece55d8-86dd-4254-9457-80e90899934a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:19.185890 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-bece55d8-86dd-4254-9457-80e90899934a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:19.210377 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-bece55d8-86dd-4254-9457-80e90899934a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.293380 Jul 14 14:32:19.218802 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 94/200] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:18 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:20.235798 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-5e64550b-c0ab-40a9-a084-639e9855f116 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:20.236462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-5e64550b-c0ab-40a9-a084-639e9855f116 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:20.243235 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5e64550b-c0ab-40a9-a084-639e9855f116 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:20.243685 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5e64550b-c0ab-40a9-a084-639e9855f116 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:20.244451 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5e64550b-c0ab-40a9-a084-639e9855f116 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:20.244876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5e64550b-c0ab-40a9-a084-639e9855f116 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:20.395086 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5e64550b-c0ab-40a9-a084-639e9855f116 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:20.404974 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-5e64550b-c0ab-40a9-a084-639e9855f116 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1520 microversion: 2.1 time: 0.172798 Jul 14 14:32:20.405467 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 107/201] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:20 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:21.424372 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-4a7b87cc-83d6-4805-b73b-77272ce95bed tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:21.425017 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-4a7b87cc-83d6-4805-b73b-77272ce95bed tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:21.432803 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=36 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:21.435081 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4a7b87cc-83d6-4805-b73b-77272ce95bed tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:21.435711 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4a7b87cc-83d6-4805-b73b-77272ce95bed tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:21.436799 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4a7b87cc-83d6-4805-b73b-77272ce95bed tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:21.437388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4a7b87cc-83d6-4805-b73b-77272ce95bed tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:21.739769 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-4a7b87cc-83d6-4805-b73b-77272ce95bed tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:21.748257 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-4a7b87cc-83d6-4805-b73b-77272ce95bed tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1500 microversion: 2.1 time: 0.329913 Jul 14 14:32:21.749109 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 95/202] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:21 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1500 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:21.765374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-952e68bd-1612-40ca-8286-c11cb50577c7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:21.766002 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-952e68bd-1612-40ca-8286-c11cb50577c7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:21.779627 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-952e68bd-1612-40ca-8286-c11cb50577c7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:21.780354 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-952e68bd-1612-40ca-8286-c11cb50577c7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:21.781112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-952e68bd-1612-40ca-8286-c11cb50577c7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:21.781486 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-952e68bd-1612-40ca-8286-c11cb50577c7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:22.090601 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-952e68bd-1612-40ca-8286-c11cb50577c7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:22.115525 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-952e68bd-1612-40ca-8286-c11cb50577c7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1515 microversion: 2.1 time: 0.353891 Jul 14 14:32:22.124917 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 108/203] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:21 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1515 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:22.735820 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-25fa2000-df43-46a0-9d06-0d918e114164 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Action: 'create', calling method: .version_select at 0x7f416c703ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-461640906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtrwjvd+EBlJ3OXOwG8ofr0UB/uU5nQ3Djr9dg5J9ORbhQ6j+S856QnAKDlbCkGcM3PSiYG/L9ayhvGEiZnAb8/M7/LR0Gu0vbN5VY/V4HNVJ041N1vJRAG/JbcJhbWoQ=="}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:22.755931 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-25fa2000-df43-46a0-9d06-0d918e114164 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Getting quotas for project 6b36d14d5bd24ed39bcb0a32dfa016f7. Resources: {'key_pairs'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:32:22.760243 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-25fa2000-df43-46a0-9d06-0d918e114164 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Getting quotas for user f86340c271b64c14b30834c51a477ca6 and project 6b36d14d5bd24ed39bcb0a32dfa016f7. Resources: {'key_pairs'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:32:22.978153 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-25fa2000-df43-46a0-9d06-0d918e114164 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.525436 Jul 14 14:32:22.979184 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 96/204] 10.222.0.93 () {60 vars in 1158 bytes} [Thu Jul 14 14:32:22 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:32:26.149090 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b4054897-d8a4-43bf-9f37-b4aa85c07402 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:26.150545 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b4054897-d8a4-43bf-9f37-b4aa85c07402 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:26.152938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:26.158600 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b4054897-d8a4-43bf-9f37-b4aa85c07402 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:26.159045 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b4054897-d8a4-43bf-9f37-b4aa85c07402 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:26.159815 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b4054897-d8a4-43bf-9f37-b4aa85c07402 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:26.160244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b4054897-d8a4-43bf-9f37-b4aa85c07402 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:26.187470 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.objects.instance [None req-b4054897-d8a4-43bf-9f37-b4aa85c07402 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lazy-loading 'flavor' on Instance uuid af404add-060a-4a34-ba63-b1df4171f2f2 {{(pid=118461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:32:26.808286 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b4054897-d8a4-43bf-9f37-b4aa85c07402 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "POST /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2/action" status: 200 len: 32 microversion: 2.1 time: 0.663497 Jul 14 14:32:26.809403 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 109/205] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 14 14:32:26 2022] POST /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2/action => generated 32 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:32:26.819035 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a63ac974-05b4-475c-8db4-eb301006c8cc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:26.819707 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a63ac974-05b4-475c-8db4-eb301006c8cc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:26.828329 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a63ac974-05b4-475c-8db4-eb301006c8cc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:26.828774 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a63ac974-05b4-475c-8db4-eb301006c8cc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:26.829556 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a63ac974-05b4-475c-8db4-eb301006c8cc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:26.830007 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a63ac974-05b4-475c-8db4-eb301006c8cc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:26.981343 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a63ac974-05b4-475c-8db4-eb301006c8cc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:26.989672 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a63ac974-05b4-475c-8db4-eb301006c8cc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1521 microversion: 2.1 time: 0.175188 Jul 14 14:32:26.990308 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 97/206] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:26 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:28.007416 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e1f7acaa-0c23-4355-9779-d36d2f98c98f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:28.008776 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e1f7acaa-0c23-4355-9779-d36d2f98c98f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:28.015722 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e1f7acaa-0c23-4355-9779-d36d2f98c98f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:28.016160 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e1f7acaa-0c23-4355-9779-d36d2f98c98f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:28.016899 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e1f7acaa-0c23-4355-9779-d36d2f98c98f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:28.017320 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e1f7acaa-0c23-4355-9779-d36d2f98c98f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:28.149746 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e1f7acaa-0c23-4355-9779-d36d2f98c98f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:28.157921 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e1f7acaa-0c23-4355-9779-d36d2f98c98f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1521 microversion: 2.1 time: 0.155403 Jul 14 14:32:28.158497 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 110/207] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:28 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:28.849146 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-38897bd1-d3c8-4234-be2a-84046a027c56 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:28.850187 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-38897bd1-d3c8-4234-be2a-84046a027c56 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:28.858390 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-38897bd1-d3c8-4234-be2a-84046a027c56 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:28.858899 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-38897bd1-d3c8-4234-be2a-84046a027c56 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:28.859850 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-38897bd1-d3c8-4234-be2a-84046a027c56 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:28.860539 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-38897bd1-d3c8-4234-be2a-84046a027c56 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:28.886466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-38897bd1-d3c8-4234-be2a-84046a027c56 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0/ips" status: 200 len: 145 microversion: 2.1 time: 0.041078 Jul 14 14:32:28.890142 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 98/208] 10.222.0.93 () {58 vars in 1247 bytes} [Thu Jul 14 14:32:28 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:29.174751 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-347e7cf4-2880-4e5b-a152-68d1c124ba84 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:29.175349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-347e7cf4-2880-4e5b-a152-68d1c124ba84 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:29.182793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-347e7cf4-2880-4e5b-a152-68d1c124ba84 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:29.183220 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-347e7cf4-2880-4e5b-a152-68d1c124ba84 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:29.183956 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-347e7cf4-2880-4e5b-a152-68d1c124ba84 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:29.184381 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-347e7cf4-2880-4e5b-a152-68d1c124ba84 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:29.323178 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-347e7cf4-2880-4e5b-a152-68d1c124ba84 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:29.331197 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-347e7cf4-2880-4e5b-a152-68d1c124ba84 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1521 microversion: 2.1 time: 0.160211 Jul 14 14:32:29.331825 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 111/209] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:29 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:32:30.350127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f60d9b5f-b3d1-48a6-b7a6-751dd66bec1d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:30.350748 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f60d9b5f-b3d1-48a6-b7a6-751dd66bec1d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:30.359108 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f60d9b5f-b3d1-48a6-b7a6-751dd66bec1d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:30.359663 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f60d9b5f-b3d1-48a6-b7a6-751dd66bec1d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:30.360556 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f60d9b5f-b3d1-48a6-b7a6-751dd66bec1d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:30.360994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f60d9b5f-b3d1-48a6-b7a6-751dd66bec1d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:30.503557 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f60d9b5f-b3d1-48a6-b7a6-751dd66bec1d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:30.513003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f60d9b5f-b3d1-48a6-b7a6-751dd66bec1d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1521 microversion: 2.1 time: 0.166600 Jul 14 14:32:30.513601 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 99/210] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:30 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:31.530584 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-54962e44-d60b-4a53-825f-99a2ba36218f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:31.531191 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-54962e44-d60b-4a53-825f-99a2ba36218f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:31.537760 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-54962e44-d60b-4a53-825f-99a2ba36218f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:31.538230 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-54962e44-d60b-4a53-825f-99a2ba36218f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:31.538983 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-54962e44-d60b-4a53-825f-99a2ba36218f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:31.540043 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-54962e44-d60b-4a53-825f-99a2ba36218f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:31.544108 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:31.678764 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-54962e44-d60b-4a53-825f-99a2ba36218f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:31.686292 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-54962e44-d60b-4a53-825f-99a2ba36218f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1521 microversion: 2.1 time: 0.159885 Jul 14 14:32:31.686846 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 112/211] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:31 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:32.703746 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-5ece0113-5129-414f-bb53-af3717a06831 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:32.704352 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-5ece0113-5129-414f-bb53-af3717a06831 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:32.710707 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5ece0113-5129-414f-bb53-af3717a06831 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:32.711684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5ece0113-5129-414f-bb53-af3717a06831 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:32.712442 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5ece0113-5129-414f-bb53-af3717a06831 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:32.712907 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5ece0113-5129-414f-bb53-af3717a06831 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:32.767016 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=4 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:32.875753 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-5ece0113-5129-414f-bb53-af3717a06831 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:32.884089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-5ece0113-5129-414f-bb53-af3717a06831 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1521 microversion: 2.1 time: 0.184299 Jul 14 14:32:32.885162 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 100/212] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:32 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:33.902629 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-14e120d4-7b07-4071-a3e1-d9a1e8702285 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:33.903273 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-14e120d4-7b07-4071-a3e1-d9a1e8702285 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:33.910264 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-14e120d4-7b07-4071-a3e1-d9a1e8702285 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:33.910732 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-14e120d4-7b07-4071-a3e1-d9a1e8702285 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:33.911490 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-14e120d4-7b07-4071-a3e1-d9a1e8702285 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:33.911925 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-14e120d4-7b07-4071-a3e1-d9a1e8702285 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:34.200048 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-14e120d4-7b07-4071-a3e1-d9a1e8702285 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:34.209002 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-14e120d4-7b07-4071-a3e1-d9a1e8702285 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1521 microversion: 2.1 time: 0.311868 Jul 14 14:32:34.210004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 113/213] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:33 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:32:35.230246 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-12465c25-84d4-40b3-a42c-fb3347ca3e7e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:35.230246 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-12465c25-84d4-40b3-a42c-fb3347ca3e7e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:35.237833 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-12465c25-84d4-40b3-a42c-fb3347ca3e7e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:35.238725 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-12465c25-84d4-40b3-a42c-fb3347ca3e7e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:35.239708 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-12465c25-84d4-40b3-a42c-fb3347ca3e7e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:35.240420 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-12465c25-84d4-40b3-a42c-fb3347ca3e7e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:35.262890 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e803756f-b816-41e9-b605-12967a6868ea tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98350bfd-8ab6-4ef3-8ea9-1e179e8d9d5a"}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:35.264144 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e803756f-b816-41e9-b605-12967a6868ea tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:35.272423 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e803756f-b816-41e9-b605-12967a6868ea tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:35.272970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e803756f-b816-41e9-b605-12967a6868ea tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:35.274446 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e803756f-b816-41e9-b605-12967a6868ea tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:35.274945 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e803756f-b816-41e9-b605-12967a6868ea tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:35.442744 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-12465c25-84d4-40b3-a42c-fb3347ca3e7e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:35.455516 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-12465c25-84d4-40b3-a42c-fb3347ca3e7e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1521 microversion: 2.1 time: 0.230703 Jul 14 14:32:35.456576 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 101/214] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:35 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:32:36.475419 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-82d9571c-1a93-449e-98c3-1ce0dac10840 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:36.475986 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-82d9571c-1a93-449e-98c3-1ce0dac10840 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:36.483487 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-82d9571c-1a93-449e-98c3-1ce0dac10840 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:36.484082 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-82d9571c-1a93-449e-98c3-1ce0dac10840 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:36.485637 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-82d9571c-1a93-449e-98c3-1ce0dac10840 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:36.486112 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-82d9571c-1a93-449e-98c3-1ce0dac10840 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:36.647247 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-82d9571c-1a93-449e-98c3-1ce0dac10840 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:36.655477 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-82d9571c-1a93-449e-98c3-1ce0dac10840 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1521 microversion: 2.1 time: 0.185434 Jul 14 14:32:36.656032 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 102/215] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:36 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:32:37.030556 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e803756f-b816-41e9-b605-12967a6868ea tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "POST /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.757947 Jul 14 14:32:37.030556 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 114/216] 10.222.0.93 () {60 vars in 1322 bytes} [Thu Jul 14 14:32:35 2022] POST /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0/os-volume_attachments => generated 194 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:32:37.673450 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-467bda14-939c-4ef0-81e9-6c97152bbe2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:37.674160 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-467bda14-939c-4ef0-81e9-6c97152bbe2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:37.680222 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-467bda14-939c-4ef0-81e9-6c97152bbe2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:37.680651 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-467bda14-939c-4ef0-81e9-6c97152bbe2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:37.684327 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-467bda14-939c-4ef0-81e9-6c97152bbe2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:37.684327 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-467bda14-939c-4ef0-81e9-6c97152bbe2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:37.900090 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-467bda14-939c-4ef0-81e9-6c97152bbe2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:37.903472 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-467bda14-939c-4ef0-81e9-6c97152bbe2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1521 microversion: 2.1 time: 0.234241 Jul 14 14:32:37.904045 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 103/217] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:37 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:38.922943 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-96fd414b-d4f1-4ba8-bf87-f289e35fdb05 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:38.923629 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-96fd414b-d4f1-4ba8-bf87-f289e35fdb05 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:38.931455 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-96fd414b-d4f1-4ba8-bf87-f289e35fdb05 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:38.932115 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-96fd414b-d4f1-4ba8-bf87-f289e35fdb05 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:38.936397 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-96fd414b-d4f1-4ba8-bf87-f289e35fdb05 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:38.939418 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-96fd414b-d4f1-4ba8-bf87-f289e35fdb05 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:39.101919 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-96fd414b-d4f1-4ba8-bf87-f289e35fdb05 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:39.102628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-96fd414b-d4f1-4ba8-bf87-f289e35fdb05 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1521 microversion: 2.1 time: 0.183853 Jul 14 14:32:39.103216 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 115/218] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:38 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:40.127142 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c1056616-998e-46fe-b8a0-8e1575746e7a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:40.127142 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c1056616-998e-46fe-b8a0-8e1575746e7a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:40.127676 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c1056616-998e-46fe-b8a0-8e1575746e7a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:40.128022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c1056616-998e-46fe-b8a0-8e1575746e7a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:40.129025 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c1056616-998e-46fe-b8a0-8e1575746e7a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:40.129462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c1056616-998e-46fe-b8a0-8e1575746e7a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:40.270081 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-c1056616-998e-46fe-b8a0-8e1575746e7a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:40.279574 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c1056616-998e-46fe-b8a0-8e1575746e7a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1521 microversion: 2.1 time: 0.162729 Jul 14 14:32:40.280258 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 104/219] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:40 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:41.299927 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-89639ee0-f554-47a4-a6d7-6243d304b460 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:41.299927 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-89639ee0-f554-47a4-a6d7-6243d304b460 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:41.304040 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-89639ee0-f554-47a4-a6d7-6243d304b460 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:41.304516 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-89639ee0-f554-47a4-a6d7-6243d304b460 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:41.305286 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-89639ee0-f554-47a4-a6d7-6243d304b460 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:41.305721 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-89639ee0-f554-47a4-a6d7-6243d304b460 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:41.442539 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-89639ee0-f554-47a4-a6d7-6243d304b460 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:41.451211 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-89639ee0-f554-47a4-a6d7-6243d304b460 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1501 microversion: 2.1 time: 0.158118 Jul 14 14:32:41.451692 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 116/220] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:41 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:41.469267 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-424a434a-e430-4f8b-a0da-97ec11489782 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "354ad96f-4075-4cd8-8cf0-ce4e83a9bc48"}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:41.470795 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-424a434a-e430-4f8b-a0da-97ec11489782 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:41.480384 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-424a434a-e430-4f8b-a0da-97ec11489782 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:41.481256 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-424a434a-e430-4f8b-a0da-97ec11489782 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:41.482591 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-424a434a-e430-4f8b-a0da-97ec11489782 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:41.483092 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-424a434a-e430-4f8b-a0da-97ec11489782 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:41.520567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-424a434a-e430-4f8b-a0da-97ec11489782 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] HTTP exception thrown: Cannot 'attach_volume' instance af404add-060a-4a34-ba63-b1df4171f2f2 while it is in vm_state rescued Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-424a434a-e430-4f8b-a0da-97ec11489782 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Request method failure captured: Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: POST /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2/os-volume_attachments HTTP/1.1 Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 74 Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0Cib88DRNxeurZ4Wu63E6s9T4DzmysupyK-6SeWi0wmSzq8BtaTmQliX_wFDfdLOwcOIILWgDDf01bHrioVSVYNSAGBd7xCTidsz4QiE-OCIkB3iwTAouBCnn7EYZLaj3-JA8txDdBnqjbDI25rRz8H2tRvQ2ayihlDNB0SB6dUQjdw Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: e2578b0e75cb455c93cf83dfe54842ff Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-254252694 Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:32:41.522278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:32:41.532888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:32:41.532888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-ServerRescueNegativeTestJSON-254252694 Jul 14 14:32:41.532888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: e2578b0e75cb455c93cf83dfe54842ff Jul 14 14:32:41.532888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-254252694 Jul 14 14:32:41.532888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-ServerRescueNegativeTestJSON-254252694-project Jul 14 14:32:41.532888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:32:41.532888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:32:41.532888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: be6cba32a31a425e964d7222c3d6b9fc Jul 14 14:32:41.532888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-ServerRescueNegativeTestJSON-254252694-project Jul 14 14:32:41.532888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Jul 14 14:32:41.532888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {"volumeAttachment": {"volumeId": "354ad96f-4075-4cd8-8cf0-ce4e83a9bc48"}} Jul 14 14:32:41.532888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:32:41.533745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Cannot 'attach_volume' instance af404add-060a-4a34-ba63-b1df4171f2f2 while it is in vm_state rescued Jul 14 14:32:41.533745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'server_id': 'af404add-060a-4a34-ba63-b1df4171f2f2', 'body': {'volumeAttachment': {'volumeId': '354ad96f-4075-4cd8-8cf0-ce4e83a9bc48'}}} Jul 14 14:32:41.533745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:32:41.533745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:41.533745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 14:32:41.533745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 14:32:41.533745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:32:41.533745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:32:41.533745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 14:32:41.533745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:32:41.533745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance af404add-060a-4a34-ba63-b1df4171f2f2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 14 14:32:41.533745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:32:41.533745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:41.533745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:32:41.533745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:41.533745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:41.533745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:41.533745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:32:41.533745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:32:41.535046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:32:41.535046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:32:41.535046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:32:41.535046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:32:41.535046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:32:41.535046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:32:41.535046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:32:41.535046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:32:41.535046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 14 14:32:41.535046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 14:32:41.535046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:32:41.535046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:32:41.535046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance af404add-060a-4a34-ba63-b1df4171f2f2 while it is in vm_state rescued Jul 14 14:32:41.535046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:32:41.535046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:32:41.535046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:32:41.535046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:32:41.535046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:32:41.535046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:32:41.536278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:32:41.536278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:32:41.536278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance af404add-060a-4a34-ba63-b1df4171f2f2 while it is in vm_state rescued Jul 14 14:32:41.536278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:32:41.536278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-424a434a-e430-4f8b-a0da-97ec11489782 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Returning 409 to user: Cannot 'attach_volume' instance af404add-060a-4a34-ba63-b1df4171f2f2 while it is in vm_state rescued {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:32:41.536278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-424a434a-e430-4f8b-a0da-97ec11489782 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "POST /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.059672 Jul 14 14:32:41.536278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 105/221] 10.222.0.93 () {60 vars in 1322 bytes} [Thu Jul 14 14:32:41 2022] POST /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2/os-volume_attachments => generated 152 bytes in 61 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:32:41.536764 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-693d9b11-d1ef-4b1c-87fb-d18074cca2ff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:41.536764 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-693d9b11-d1ef-4b1c-87fb-d18074cca2ff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:41.540890 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-693d9b11-d1ef-4b1c-87fb-d18074cca2ff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:41.541326 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-693d9b11-d1ef-4b1c-87fb-d18074cca2ff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:41.542154 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-693d9b11-d1ef-4b1c-87fb-d18074cca2ff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:41.542583 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-693d9b11-d1ef-4b1c-87fb-d18074cca2ff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:41.854143 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-693d9b11-d1ef-4b1c-87fb-d18074cca2ff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "POST /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2/action" status: 202 len: 0 microversion: 2.1 time: 0.324294 Jul 14 14:32:41.855176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 117/222] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 14 14:32:41 2022] POST /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:32:41.877380 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c1107d89-d9c9-4e94-9431-a41244583891 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:41.877380 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c1107d89-d9c9-4e94-9431-a41244583891 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:41.882503 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c1107d89-d9c9-4e94-9431-a41244583891 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:41.883567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c1107d89-d9c9-4e94-9431-a41244583891 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:41.884370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c1107d89-d9c9-4e94-9431-a41244583891 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:41.884804 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c1107d89-d9c9-4e94-9431-a41244583891 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:42.058202 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-c1107d89-d9c9-4e94-9431-a41244583891 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:42.067389 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c1107d89-d9c9-4e94-9431-a41244583891 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1509 microversion: 2.1 time: 0.207327 Jul 14 14:32:42.068794 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 106/223] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:41 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:43.098350 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-195bbdbb-82cf-4d91-9504-ec36db1f5c15 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:43.099510 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-195bbdbb-82cf-4d91-9504-ec36db1f5c15 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:43.110588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-195bbdbb-82cf-4d91-9504-ec36db1f5c15 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:43.111507 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-195bbdbb-82cf-4d91-9504-ec36db1f5c15 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:43.112435 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-195bbdbb-82cf-4d91-9504-ec36db1f5c15 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:43.113140 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-195bbdbb-82cf-4d91-9504-ec36db1f5c15 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:43.286948 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-195bbdbb-82cf-4d91-9504-ec36db1f5c15 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:43.294684 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-195bbdbb-82cf-4d91-9504-ec36db1f5c15 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1509 microversion: 2.1 time: 0.205591 Jul 14 14:32:43.295548 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 118/224] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:43 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1509 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:44.312300 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ecabe340-ce5e-4279-a0c2-3099d0138591 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:44.312901 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ecabe340-ce5e-4279-a0c2-3099d0138591 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:44.322991 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ecabe340-ce5e-4279-a0c2-3099d0138591 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:44.323728 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ecabe340-ce5e-4279-a0c2-3099d0138591 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:44.326580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ecabe340-ce5e-4279-a0c2-3099d0138591 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:44.327283 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ecabe340-ce5e-4279-a0c2-3099d0138591 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:44.333186 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=85 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:44.481807 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ecabe340-ce5e-4279-a0c2-3099d0138591 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:44.492105 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ecabe340-ce5e-4279-a0c2-3099d0138591 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1509 microversion: 2.1 time: 0.180783 Jul 14 14:32:44.492105 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 107/225] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:44 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:45.508753 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-293096df-c8e9-44a3-afa2-2daab9833627 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:45.510006 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-293096df-c8e9-44a3-afa2-2daab9833627 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:45.518608 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-293096df-c8e9-44a3-afa2-2daab9833627 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:45.520474 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-293096df-c8e9-44a3-afa2-2daab9833627 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:45.523477 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-293096df-c8e9-44a3-afa2-2daab9833627 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:45.523477 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-293096df-c8e9-44a3-afa2-2daab9833627 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:45.722532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-293096df-c8e9-44a3-afa2-2daab9833627 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:45.731131 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-293096df-c8e9-44a3-afa2-2daab9833627 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1515 microversion: 2.1 time: 0.227418 Jul 14 14:32:45.731717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 119/226] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:45 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1515 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:46.893761 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0237ab75-b8eb-4291-bced-fe8e25b4d579 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:46.902331 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0237ab75-b8eb-4291-bced-fe8e25b4d579 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:46.903106 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0237ab75-b8eb-4291-bced-fe8e25b4d579 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:46.988312 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0237ab75-b8eb-4291-bced-fe8e25b4d579 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Going to try to stop instance {{(pid=118462) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 14:32:47.302119 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0237ab75-b8eb-4291-bced-fe8e25b4d579 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "POST /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0/action" status: 202 len: 0 microversion: 2.1 time: 0.412451 Jul 14 14:32:47.302720 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 108/227] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 14 14:32:46 2022] POST /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:32:47.311612 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-bb273142-b560-427e-89e2-4fb2e3fa0e6a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:47.312271 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-bb273142-b560-427e-89e2-4fb2e3fa0e6a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:47.318981 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bb273142-b560-427e-89e2-4fb2e3fa0e6a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:47.319418 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bb273142-b560-427e-89e2-4fb2e3fa0e6a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:47.320698 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bb273142-b560-427e-89e2-4fb2e3fa0e6a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:47.321312 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bb273142-b560-427e-89e2-4fb2e3fa0e6a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:47.466495 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-bb273142-b560-427e-89e2-4fb2e3fa0e6a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:47.473079 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-bb273142-b560-427e-89e2-4fb2e3fa0e6a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1723 microversion: 2.1 time: 0.165505 Jul 14 14:32:47.473633 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 120/228] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:47 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:48.145736 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-55869dc5-93f8-4d79-b69b-fc7d53c83693 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Action: 'create', calling method: .version_select at 0x7f416c6b1160>, body: {"keypair": {"name": "tempest-keypair-366081478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzz+NUMA0mF/4IvgvOWMGN5U1DVwB83vln3+UOWGwPq3CIPcQZasDbmdwfSrfM1mf8rA8ubrZYt59xUirg0YcdcW9kRIiaCDgviKALF/23twfKAmg8OkRb8/wQCPlpuKQ=="}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:48.160707 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-55869dc5-93f8-4d79-b69b-fc7d53c83693 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Getting quotas for project e2578b0e75cb455c93cf83dfe54842ff. Resources: {'key_pairs'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:32:48.164577 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-55869dc5-93f8-4d79-b69b-fc7d53c83693 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Getting quotas for user be6cba32a31a425e964d7222c3d6b9fc and project e2578b0e75cb455c93cf83dfe54842ff. Resources: {'key_pairs'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:32:48.346727 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-55869dc5-93f8-4d79-b69b-fc7d53c83693 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.205266 Jul 14 14:32:48.347327 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 109/229] 10.222.0.93 () {60 vars in 1158 bytes} [Thu Jul 14 14:32:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:32:48.495329 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4ab41da0-f964-4c0e-bc47-18db878c7bf1 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:48.495329 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-4ab41da0-f964-4c0e-bc47-18db878c7bf1 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:48.501947 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4ab41da0-f964-4c0e-bc47-18db878c7bf1 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:48.502520 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4ab41da0-f964-4c0e-bc47-18db878c7bf1 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:48.503338 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4ab41da0-f964-4c0e-bc47-18db878c7bf1 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:48.503775 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4ab41da0-f964-4c0e-bc47-18db878c7bf1 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:48.650420 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4ab41da0-f964-4c0e-bc47-18db878c7bf1 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:48.659724 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4ab41da0-f964-4c0e-bc47-18db878c7bf1 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1723 microversion: 2.1 time: 0.171798 Jul 14 14:32:48.660675 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 121/230] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:48 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:49.677145 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-22864579-09db-436e-afa0-1e14ee55fd58 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:49.678277 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-22864579-09db-436e-afa0-1e14ee55fd58 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:49.685632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-22864579-09db-436e-afa0-1e14ee55fd58 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:49.686242 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-22864579-09db-436e-afa0-1e14ee55fd58 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:49.687045 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-22864579-09db-436e-afa0-1e14ee55fd58 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:49.687483 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-22864579-09db-436e-afa0-1e14ee55fd58 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:49.826021 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-22864579-09db-436e-afa0-1e14ee55fd58 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:49.836029 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-22864579-09db-436e-afa0-1e14ee55fd58 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1723 microversion: 2.1 time: 0.162763 Jul 14 14:32:49.847470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 110/231] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:49 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:50.863504 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-efb16d1f-ce73-43e9-9236-0ca874ae24fb tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:50.864112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-efb16d1f-ce73-43e9-9236-0ca874ae24fb tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:50.871084 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-efb16d1f-ce73-43e9-9236-0ca874ae24fb tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:50.871519 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-efb16d1f-ce73-43e9-9236-0ca874ae24fb tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:50.872292 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-efb16d1f-ce73-43e9-9236-0ca874ae24fb tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:50.872734 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-efb16d1f-ce73-43e9-9236-0ca874ae24fb tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:51.253352 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-efb16d1f-ce73-43e9-9236-0ca874ae24fb tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:51.263553 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-efb16d1f-ce73-43e9-9236-0ca874ae24fb tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1723 microversion: 2.1 time: 0.403655 Jul 14 14:32:51.264128 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 122/232] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:50 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1723 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:51.699384 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-8fdb66f4-e7cf-4deb-8e3d-bda31e334b9a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1044315551", "imageRef": "7ea875a4-facb-4053-be2d-ff0080d2f3a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8b5e31c-98ed-487e-830d-724f1cd2a8c8"}], "security_groups": [{"name": "tempest-securitygroup--148160425"}], "key_name": "tempest-keypair-366081478", "user_data": "}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:52.130957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.network.neutron [None req-8fdb66f4-e7cf-4deb-8e3d-bda31e334b9a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] validate_networks() for [('d8b5e31c-98ed-487e-830d-724f1cd2a8c8', None, None, None, None, None)] {{(pid=118462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:32:52.204611 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-8fdb66f4-e7cf-4deb-8e3d-bda31e334b9a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Flavor limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:32:52.205081 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-8fdb66f4-e7cf-4deb-8e3d-bda31e334b9a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Image limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:32:52.205554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-8fdb66f4-e7cf-4deb-8e3d-bda31e334b9a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Flavor pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:32:52.206090 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-8fdb66f4-e7cf-4deb-8e3d-bda31e334b9a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Image pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:32:52.206553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-8fdb66f4-e7cf-4deb-8e3d-bda31e334b9a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:32:52.216298 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8fdb66f4-e7cf-4deb-8e3d-bda31e334b9a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:52.216743 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8fdb66f4-e7cf-4deb-8e3d-bda31e334b9a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:52.217534 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8fdb66f4-e7cf-4deb-8e3d-bda31e334b9a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:52.218002 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8fdb66f4-e7cf-4deb-8e3d-bda31e334b9a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:52.236262 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-8fdb66f4-e7cf-4deb-8e3d-bda31e334b9a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Getting quotas for project e2578b0e75cb455c93cf83dfe54842ff. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:32:52.246963 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-8fdb66f4-e7cf-4deb-8e3d-bda31e334b9a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Getting quotas for user be6cba32a31a425e964d7222c3d6b9fc and project e2578b0e75cb455c93cf83dfe54842ff. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:32:52.251970 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-8fdb66f4-e7cf-4deb-8e3d-bda31e334b9a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Going to run 1 instances... {{(pid=118462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:32:52.254265 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-8fdb66f4-e7cf-4deb-8e3d-bda31e334b9a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ea875a4-facb-4053-be2d-ff0080d2f3a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:32:52.282419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0df4e55d-f6b4-4047-97dc-1e4cde9f8500 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:52.283623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-0df4e55d-f6b4-4047-97dc-1e4cde9f8500 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:52.290484 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0df4e55d-f6b4-4047-97dc-1e4cde9f8500 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:52.290929 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0df4e55d-f6b4-4047-97dc-1e4cde9f8500 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:52.292310 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0df4e55d-f6b4-4047-97dc-1e4cde9f8500 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:52.292916 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0df4e55d-f6b4-4047-97dc-1e4cde9f8500 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:52.437528 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-0df4e55d-f6b4-4047-97dc-1e4cde9f8500 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:52.446124 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-0df4e55d-f6b4-4047-97dc-1e4cde9f8500 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1723 microversion: 2.1 time: 0.167898 Jul 14 14:32:52.446692 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 123/233] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:52 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:32:52.578426 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-8fdb66f4-e7cf-4deb-8e3d-bda31e334b9a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.883436 Jul 14 14:32:52.579068 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 111/234] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:32:51 2022] POST /compute/v2.1/servers => generated 408 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:32:52.588852 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-144531cd-cab3-4a56-a31f-6dfe834cbfdd tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:52.589570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-144531cd-cab3-4a56-a31f-6dfe834cbfdd tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:52.649354 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-144531cd-cab3-4a56-a31f-6dfe834cbfdd tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:52.654718 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-144531cd-cab3-4a56-a31f-6dfe834cbfdd tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1245 microversion: 2.1 time: 0.069583 Jul 14 14:32:52.655375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 124/235] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:52 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:53.463857 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-aa9196ee-6f40-4e93-82c6-c5b1a9b3a8d4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:53.464507 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-aa9196ee-6f40-4e93-82c6-c5b1a9b3a8d4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:53.471482 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-aa9196ee-6f40-4e93-82c6-c5b1a9b3a8d4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:53.471944 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-aa9196ee-6f40-4e93-82c6-c5b1a9b3a8d4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:53.472732 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-aa9196ee-6f40-4e93-82c6-c5b1a9b3a8d4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:53.473186 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-aa9196ee-6f40-4e93-82c6-c5b1a9b3a8d4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:53.605492 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-aa9196ee-6f40-4e93-82c6-c5b1a9b3a8d4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:53.613606 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-aa9196ee-6f40-4e93-82c6-c5b1a9b3a8d4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1723 microversion: 2.1 time: 0.154351 Jul 14 14:32:53.614202 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 112/236] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:53 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:53.677543 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-65922676-41b7-49e1-89e3-f667a26cfe7a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:53.678820 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-65922676-41b7-49e1-89e3-f667a26cfe7a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:53.742515 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-65922676-41b7-49e1-89e3-f667a26cfe7a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:53.749746 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-65922676-41b7-49e1-89e3-f667a26cfe7a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1245 microversion: 2.1 time: 0.080483 Jul 14 14:32:53.750324 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 125/237] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:53 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:54.249965 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-283de862-6b9d-4ffb-b6e7-7159273e8cac tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-692976525", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-461640906", "security_groups": [{"name": "tempest-secgroup-smoke-809734615"}], "networks": [{"uuid": "94445a67-02a7-44f8-b413-c6bbd14cbf31"}], "block_device_mapping_v2": [{"uuid": "a7865e67-d2a5-4a5d-abbe-bd00c8ea0058", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:32:54.373460 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.network.neutron [None req-283de862-6b9d-4ffb-b6e7-7159273e8cac tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] validate_networks() for [('94445a67-02a7-44f8-b413-c6bbd14cbf31', None, None, None, None, None)] {{(pid=118462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:32:54.630644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-38792e30-c600-4d01-ac67-f491b55d224a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:54.631245 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-38792e30-c600-4d01-ac67-f491b55d224a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:54.637553 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-38792e30-c600-4d01-ac67-f491b55d224a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:54.639737 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-38792e30-c600-4d01-ac67-f491b55d224a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:54.639737 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-38792e30-c600-4d01-ac67-f491b55d224a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:54.639737 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-38792e30-c600-4d01-ac67-f491b55d224a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:54.831673 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-283de862-6b9d-4ffb-b6e7-7159273e8cac tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Flavor limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:32:54.832147 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-283de862-6b9d-4ffb-b6e7-7159273e8cac tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Image limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:32:54.832971 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-283de862-6b9d-4ffb-b6e7-7159273e8cac tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Flavor pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:32:54.833172 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-283de862-6b9d-4ffb-b6e7-7159273e8cac tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Image pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:32:54.833674 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-283de862-6b9d-4ffb-b6e7-7159273e8cac tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:32:54.843174 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-283de862-6b9d-4ffb-b6e7-7159273e8cac tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:54.843734 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-283de862-6b9d-4ffb-b6e7-7159273e8cac tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:54.845253 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-283de862-6b9d-4ffb-b6e7-7159273e8cac tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:54.845702 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-283de862-6b9d-4ffb-b6e7-7159273e8cac tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:54.846911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-38792e30-c600-4d01-ac67-f491b55d224a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:54.855247 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-38792e30-c600-4d01-ac67-f491b55d224a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1723 microversion: 2.1 time: 0.228513 Jul 14 14:32:54.856079 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 126/238] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:54 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:32:54.861085 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-3e096a90-a394-46e1-866c-647b8ef1fe81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:54.861633 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-3e096a90-a394-46e1-866c-647b8ef1fe81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:54.863589 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-283de862-6b9d-4ffb-b6e7-7159273e8cac tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Getting quotas for project 6b36d14d5bd24ed39bcb0a32dfa016f7. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:32:54.867494 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-283de862-6b9d-4ffb-b6e7-7159273e8cac tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Getting quotas for user f86340c271b64c14b30834c51a477ca6 and project 6b36d14d5bd24ed39bcb0a32dfa016f7. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:32:54.872581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3e096a90-a394-46e1-866c-647b8ef1fe81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:54.872581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3e096a90-a394-46e1-866c-647b8ef1fe81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:54.872581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3e096a90-a394-46e1-866c-647b8ef1fe81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:54.872581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3e096a90-a394-46e1-866c-647b8ef1fe81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:54.925111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-283de862-6b9d-4ffb-b6e7-7159273e8cac tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Going to run 1 instances... {{(pid=118462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:32:54.927434 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-283de862-6b9d-4ffb-b6e7-7159273e8cac tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a7865e67-d2a5-4a5d-abbe-bd00c8ea0058',volume_size=None,volume_type=None)] {{(pid=118462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:32:54.947141 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3e096a90-a394-46e1-866c-647b8ef1fe81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:54.955934 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-3e096a90-a394-46e1-866c-647b8ef1fe81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1241 microversion: 2.1 time: 0.095918 Jul 14 14:32:54.956471 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 127/239] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:54 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:55.532038 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-283de862-6b9d-4ffb-b6e7-7159273e8cac tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.285970 Jul 14 14:32:55.537736 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 113/240] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:32:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:32:55.543000 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a1163c39-2073-4f0c-b9c7-0b97f4cfb49b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:55.543685 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a1163c39-2073-4f0c-b9c7-0b97f4cfb49b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:55.603815 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a1163c39-2073-4f0c-b9c7-0b97f4cfb49b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:55.608611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a1163c39-2073-4f0c-b9c7-0b97f4cfb49b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1087 microversion: 2.1 time: 0.069618 Jul 14 14:32:55.609270 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 128/241] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:55 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1087 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:32:55.874827 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-2d7ef5e8-8d4d-4269-95dd-4d19b52e6c3e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:55.875417 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-2d7ef5e8-8d4d-4269-95dd-4d19b52e6c3e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:55.881717 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2d7ef5e8-8d4d-4269-95dd-4d19b52e6c3e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:55.882189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2d7ef5e8-8d4d-4269-95dd-4d19b52e6c3e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:55.882933 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2d7ef5e8-8d4d-4269-95dd-4d19b52e6c3e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:55.883361 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2d7ef5e8-8d4d-4269-95dd-4d19b52e6c3e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:55.973109 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-de530ac4-cb14-4df2-8b00-a34d4231b290 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:55.979217 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-de530ac4-cb14-4df2-8b00-a34d4231b290 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:55.990732 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-de530ac4-cb14-4df2-8b00-a34d4231b290 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:55.991204 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-de530ac4-cb14-4df2-8b00-a34d4231b290 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:55.992203 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-de530ac4-cb14-4df2-8b00-a34d4231b290 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:55.993068 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-de530ac4-cb14-4df2-8b00-a34d4231b290 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:56.012915 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:56.016046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-2d7ef5e8-8d4d-4269-95dd-4d19b52e6c3e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:56.025678 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-2d7ef5e8-8d4d-4269-95dd-4d19b52e6c3e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1723 microversion: 2.1 time: 0.153772 Jul 14 14:32:56.025678 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 114/242] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:55 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:56.059569 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-de530ac4-cb14-4df2-8b00-a34d4231b290 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:56.067257 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-de530ac4-cb14-4df2-8b00-a34d4231b290 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1241 microversion: 2.1 time: 0.098307 Jul 14 14:32:56.067830 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 129/243] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:55 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:32:56.626609 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-4290e568-c64f-4ad1-b796-f741fef1a3c3 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:56.627221 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-4290e568-c64f-4ad1-b796-f741fef1a3c3 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:56.633214 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4290e568-c64f-4ad1-b796-f741fef1a3c3 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:56.639324 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4290e568-c64f-4ad1-b796-f741fef1a3c3 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:56.639324 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4290e568-c64f-4ad1-b796-f741fef1a3c3 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:56.639324 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4290e568-c64f-4ad1-b796-f741fef1a3c3 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:56.708095 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-4290e568-c64f-4ad1-b796-f741fef1a3c3 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:56.715912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-4290e568-c64f-4ad1-b796-f741fef1a3c3 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1137 microversion: 2.1 time: 0.093132 Jul 14 14:32:56.716475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 115/244] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:56 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1137 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:57.042767 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-38b4422e-a52e-4527-ac94-6e817895ea64 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:57.043375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-38b4422e-a52e-4527-ac94-6e817895ea64 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:57.050210 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-38b4422e-a52e-4527-ac94-6e817895ea64 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:57.050656 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-38b4422e-a52e-4527-ac94-6e817895ea64 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:57.051416 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-38b4422e-a52e-4527-ac94-6e817895ea64 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:57.051847 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-38b4422e-a52e-4527-ac94-6e817895ea64 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:57.084851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7196cf4b-2c44-480b-9177-bc86da9be5da tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:57.085558 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-7196cf4b-2c44-480b-9177-bc86da9be5da tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:57.090237 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:32:57.102002 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7196cf4b-2c44-480b-9177-bc86da9be5da tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:57.102501 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7196cf4b-2c44-480b-9177-bc86da9be5da tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:57.103284 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7196cf4b-2c44-480b-9177-bc86da9be5da tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:57.103714 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7196cf4b-2c44-480b-9177-bc86da9be5da tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:57.175718 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7196cf4b-2c44-480b-9177-bc86da9be5da tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:57.183338 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-7196cf4b-2c44-480b-9177-bc86da9be5da tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1241 microversion: 2.1 time: 0.103202 Jul 14 14:32:57.184123 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 116/245] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:57 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:32:57.223546 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-38b4422e-a52e-4527-ac94-6e817895ea64 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:57.240459 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-38b4422e-a52e-4527-ac94-6e817895ea64 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1723 microversion: 2.1 time: 0.202399 Jul 14 14:32:57.241049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 130/246] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:57 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:57.733251 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-be352cc6-fc61-4245-8fe0-de415d26f303 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:57.733923 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-be352cc6-fc61-4245-8fe0-de415d26f303 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:57.740121 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-be352cc6-fc61-4245-8fe0-de415d26f303 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:57.740978 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-be352cc6-fc61-4245-8fe0-de415d26f303 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:57.741311 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-be352cc6-fc61-4245-8fe0-de415d26f303 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:57.741742 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-be352cc6-fc61-4245-8fe0-de415d26f303 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:57.804966 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-be352cc6-fc61-4245-8fe0-de415d26f303 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:57.812441 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-be352cc6-fc61-4245-8fe0-de415d26f303 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1129 microversion: 2.1 time: 0.083309 Jul 14 14:32:57.813180 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 117/247] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:57 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1129 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:32:58.200674 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0761e98b-bc3b-4071-812e-ce584123f503 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:58.201323 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-0761e98b-bc3b-4071-812e-ce584123f503 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:58.208470 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0761e98b-bc3b-4071-812e-ce584123f503 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:58.208911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0761e98b-bc3b-4071-812e-ce584123f503 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:58.209661 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0761e98b-bc3b-4071-812e-ce584123f503 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:58.210111 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0761e98b-bc3b-4071-812e-ce584123f503 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:58.258058 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d45848e6-5446-4ea4-a863-98da8eb51a62 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:58.258686 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-d45848e6-5446-4ea4-a863-98da8eb51a62 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:58.266238 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d45848e6-5446-4ea4-a863-98da8eb51a62 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:58.266739 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d45848e6-5446-4ea4-a863-98da8eb51a62 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:58.267538 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d45848e6-5446-4ea4-a863-98da8eb51a62 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:58.267973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d45848e6-5446-4ea4-a863-98da8eb51a62 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:58.275293 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-0761e98b-bc3b-4071-812e-ce584123f503 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:58.285177 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-0761e98b-bc3b-4071-812e-ce584123f503 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1305 microversion: 2.1 time: 0.088287 Jul 14 14:32:58.285815 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 131/248] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:58 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1305 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:58.414151 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-d45848e6-5446-4ea4-a863-98da8eb51a62 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:58.422135 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-d45848e6-5446-4ea4-a863-98da8eb51a62 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1723 microversion: 2.1 time: 0.168913 Jul 14 14:32:58.423057 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 118/249] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:58 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:32:58.829758 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-6d84e111-8d03-4468-a3f0-0fdf1a9d5450 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:58.830315 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-6d84e111-8d03-4468-a3f0-0fdf1a9d5450 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:58.839455 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6d84e111-8d03-4468-a3f0-0fdf1a9d5450 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:58.839835 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6d84e111-8d03-4468-a3f0-0fdf1a9d5450 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:58.840624 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6d84e111-8d03-4468-a3f0-0fdf1a9d5450 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:58.841067 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6d84e111-8d03-4468-a3f0-0fdf1a9d5450 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:58.935107 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-6d84e111-8d03-4468-a3f0-0fdf1a9d5450 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:58.942720 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-6d84e111-8d03-4468-a3f0-0fdf1a9d5450 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1193 microversion: 2.1 time: 0.116838 Jul 14 14:32:58.947383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 132/250] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:58 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1193 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:59.309046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f82445b8-f718-4005-bb72-3932ad7cd2c0 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:59.309719 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f82445b8-f718-4005-bb72-3932ad7cd2c0 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:59.316582 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f82445b8-f718-4005-bb72-3932ad7cd2c0 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:59.317039 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f82445b8-f718-4005-bb72-3932ad7cd2c0 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:59.317830 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f82445b8-f718-4005-bb72-3932ad7cd2c0 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:59.318450 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f82445b8-f718-4005-bb72-3932ad7cd2c0 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:59.386043 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f82445b8-f718-4005-bb72-3932ad7cd2c0 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:59.393583 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f82445b8-f718-4005-bb72-3932ad7cd2c0 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1303 microversion: 2.1 time: 0.089471 Jul 14 14:32:59.397400 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 119/251] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:59 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1303 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:59.439903 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4277e904-d93f-4d3b-a089-216e42482058 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:59.440517 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-4277e904-d93f-4d3b-a089-216e42482058 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:59.448529 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4277e904-d93f-4d3b-a089-216e42482058 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:59.448529 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4277e904-d93f-4d3b-a089-216e42482058 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:59.448856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4277e904-d93f-4d3b-a089-216e42482058 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:59.449285 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4277e904-d93f-4d3b-a089-216e42482058 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:59.600020 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4277e904-d93f-4d3b-a089-216e42482058 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:32:59.610089 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4277e904-d93f-4d3b-a089-216e42482058 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1723 microversion: 2.1 time: 0.174497 Jul 14 14:32:59.611225 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 133/252] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:59 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:32:59.961054 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-65b7375f-0173-4c2f-b730-097776d5185d tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:32:59.961665 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-65b7375f-0173-4c2f-b730-097776d5185d tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:32:59.968179 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-65b7375f-0173-4c2f-b730-097776d5185d tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:59.968635 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-65b7375f-0173-4c2f-b730-097776d5185d tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:32:59.969413 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-65b7375f-0173-4c2f-b730-097776d5185d tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:32:59.969914 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-65b7375f-0173-4c2f-b730-097776d5185d tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:00.108000 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-65b7375f-0173-4c2f-b730-097776d5185d tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:00.115475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-65b7375f-0173-4c2f-b730-097776d5185d tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1270 microversion: 2.1 time: 0.158917 Jul 14 14:33:00.116136 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 120/253] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:32:59 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:00.410723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-23c323fc-7472-4d58-aa02-5915fe941789 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:00.411322 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-23c323fc-7472-4d58-aa02-5915fe941789 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:00.417246 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-23c323fc-7472-4d58-aa02-5915fe941789 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:00.419584 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-23c323fc-7472-4d58-aa02-5915fe941789 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:00.419584 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-23c323fc-7472-4d58-aa02-5915fe941789 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:00.419584 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-23c323fc-7472-4d58-aa02-5915fe941789 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:00.546127 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-23c323fc-7472-4d58-aa02-5915fe941789 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:00.553551 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-23c323fc-7472-4d58-aa02-5915fe941789 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1370 microversion: 2.1 time: 0.146718 Jul 14 14:33:00.554193 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 134/254] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:00 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:00.628359 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-fff5e934-3211-425a-b2ad-591a4c9ff924 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:00.629115 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-fff5e934-3211-425a-b2ad-591a4c9ff924 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:00.635918 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fff5e934-3211-425a-b2ad-591a4c9ff924 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:00.636363 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fff5e934-3211-425a-b2ad-591a4c9ff924 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:00.637108 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fff5e934-3211-425a-b2ad-591a4c9ff924 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:00.637530 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fff5e934-3211-425a-b2ad-591a4c9ff924 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:00.768311 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-fff5e934-3211-425a-b2ad-591a4c9ff924 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:00.777207 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-fff5e934-3211-425a-b2ad-591a4c9ff924 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1723 microversion: 2.1 time: 0.152852 Jul 14 14:33:00.777779 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 121/255] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:00 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:01.135567 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-11110c4d-6631-45f9-b07f-6a75d577f97e tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:01.136169 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-11110c4d-6631-45f9-b07f-6a75d577f97e tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:01.142151 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-11110c4d-6631-45f9-b07f-6a75d577f97e tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:01.142621 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-11110c4d-6631-45f9-b07f-6a75d577f97e tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:01.143374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-11110c4d-6631-45f9-b07f-6a75d577f97e tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:01.143801 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-11110c4d-6631-45f9-b07f-6a75d577f97e tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:01.301940 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-11110c4d-6631-45f9-b07f-6a75d577f97e tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:01.310177 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-11110c4d-6631-45f9-b07f-6a75d577f97e tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1270 microversion: 2.1 time: 0.178968 Jul 14 14:33:01.310739 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 135/256] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:01 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:01.570223 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ad611687-c6e0-4945-9994-ac4ade620871 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:01.570825 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ad611687-c6e0-4945-9994-ac4ade620871 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:01.576726 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ad611687-c6e0-4945-9994-ac4ade620871 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:01.584171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ad611687-c6e0-4945-9994-ac4ade620871 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:01.584171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ad611687-c6e0-4945-9994-ac4ade620871 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:01.584171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ad611687-c6e0-4945-9994-ac4ade620871 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:01.704976 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ad611687-c6e0-4945-9994-ac4ade620871 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:01.713658 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ad611687-c6e0-4945-9994-ac4ade620871 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1370 microversion: 2.1 time: 0.147274 Jul 14 14:33:01.716962 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 122/257] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:01 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:01.797254 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-2efc2246-f28a-4c29-8a7f-56d0d2fb7c37 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:01.798189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-2efc2246-f28a-4c29-8a7f-56d0d2fb7c37 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:01.801549 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=60 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:01.805325 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2efc2246-f28a-4c29-8a7f-56d0d2fb7c37 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:01.814256 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2efc2246-f28a-4c29-8a7f-56d0d2fb7c37 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:01.814256 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2efc2246-f28a-4c29-8a7f-56d0d2fb7c37 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:01.814256 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2efc2246-f28a-4c29-8a7f-56d0d2fb7c37 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:01.951220 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-2efc2246-f28a-4c29-8a7f-56d0d2fb7c37 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:01.959780 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-2efc2246-f28a-4c29-8a7f-56d0d2fb7c37 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1723 microversion: 2.1 time: 0.168560 Jul 14 14:33:01.968211 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 136/258] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:01 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:02.327703 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ebf08e4f-53d8-47b9-9f90-a227ca0cb449 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:02.327703 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ebf08e4f-53d8-47b9-9f90-a227ca0cb449 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:02.333897 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ebf08e4f-53d8-47b9-9f90-a227ca0cb449 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:02.334349 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ebf08e4f-53d8-47b9-9f90-a227ca0cb449 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:02.335114 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ebf08e4f-53d8-47b9-9f90-a227ca0cb449 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:02.335549 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ebf08e4f-53d8-47b9-9f90-a227ca0cb449 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:02.471255 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ebf08e4f-53d8-47b9-9f90-a227ca0cb449 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:02.478673 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ebf08e4f-53d8-47b9-9f90-a227ca0cb449 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1270 microversion: 2.1 time: 0.155600 Jul 14 14:33:02.479174 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 123/259] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:02 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:02.752800 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4ba7f55f-336b-4160-a78c-03a1ea02d3d7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:02.753530 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-4ba7f55f-336b-4160-a78c-03a1ea02d3d7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:02.766276 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4ba7f55f-336b-4160-a78c-03a1ea02d3d7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:02.767124 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4ba7f55f-336b-4160-a78c-03a1ea02d3d7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:02.768391 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4ba7f55f-336b-4160-a78c-03a1ea02d3d7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:02.769027 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4ba7f55f-336b-4160-a78c-03a1ea02d3d7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:02.947146 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4ba7f55f-336b-4160-a78c-03a1ea02d3d7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:02.955517 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4ba7f55f-336b-4160-a78c-03a1ea02d3d7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1370 microversion: 2.1 time: 0.226185 Jul 14 14:33:02.965050 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 137/260] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:02 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1370 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:02.984750 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e91cc18c-7ac1-4a6b-a7c2-f5b1e49be2df tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:02.985278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e91cc18c-7ac1-4a6b-a7c2-f5b1e49be2df tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:02.991322 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e91cc18c-7ac1-4a6b-a7c2-f5b1e49be2df tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:02.991758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e91cc18c-7ac1-4a6b-a7c2-f5b1e49be2df tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:03.018615 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e91cc18c-7ac1-4a6b-a7c2-f5b1e49be2df tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:03.018615 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e91cc18c-7ac1-4a6b-a7c2-f5b1e49be2df tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:03.173298 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e91cc18c-7ac1-4a6b-a7c2-f5b1e49be2df tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:03.177674 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-f39315ad-7cfb-436f-a076-6c765e92fdb9 req-b465a6ff-4b86-4ab3-9ecd-b114c4a7ce37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d79f9504-35ca-452e-8c51-8db181ea74a7", "tag": "1aed1e1d-edb5-41ea-ac88-358515dbc3f6"}, {"name": "network-changed", "server_uuid": "833f486d-a5d2-41ff-8404-19f21892e73c", "tag": "7f554063-5f76-4260-95f2-f9417cf2981a"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:03.182698 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e91cc18c-7ac1-4a6b-a7c2-f5b1e49be2df tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1723 microversion: 2.1 time: 0.202053 Jul 14 14:33:03.184802 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 124/261] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:02 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:03.214909 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-f39315ad-7cfb-436f-a076-6c765e92fdb9 req-b465a6ff-4b86-4ab3-9ecd-b114c4a7ce37 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:03.216302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-f39315ad-7cfb-436f-a076-6c765e92fdb9 req-b465a6ff-4b86-4ab3-9ecd-b114c4a7ce37 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:03.240968 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-f39315ad-7cfb-436f-a076-6c765e92fdb9 req-b465a6ff-4b86-4ab3-9ecd-b114c4a7ce37 service nova] Creating event network-changed:1aed1e1d-edb5-41ea-ac88-358515dbc3f6 for instance d79f9504-35ca-452e-8c51-8db181ea74a7 on hv-cinder-79987 Jul 14 14:33:03.241578 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-f39315ad-7cfb-436f-a076-6c765e92fdb9 req-b465a6ff-4b86-4ab3-9ecd-b114c4a7ce37 service nova] Creating event network-changed:7f554063-5f76-4260-95f2-f9417cf2981a for instance 833f486d-a5d2-41ff-8404-19f21892e73c on hv-cinder-79987 Jul 14 14:33:03.254703 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-f39315ad-7cfb-436f-a076-6c765e92fdb9 req-b465a6ff-4b86-4ab3-9ecd-b114c4a7ce37 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.096948 Jul 14 14:33:03.255952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 138/262] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:03.499391 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-dd7c6066-6d3a-4817-834c-c785959322d0 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:03.510078 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-dd7c6066-6d3a-4817-834c-c785959322d0 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:03.517202 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-dd7c6066-6d3a-4817-834c-c785959322d0 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:03.518799 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-dd7c6066-6d3a-4817-834c-c785959322d0 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:03.519748 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-dd7c6066-6d3a-4817-834c-c785959322d0 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:03.520627 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-dd7c6066-6d3a-4817-834c-c785959322d0 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:03.529901 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:03.712065 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-dd7c6066-6d3a-4817-834c-c785959322d0 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:03.720109 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-dd7c6066-6d3a-4817-834c-c785959322d0 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1270 microversion: 2.1 time: 0.227374 Jul 14 14:33:03.720730 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 125/263] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:03 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1270 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:03.973897 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f27094c8-bdc9-4878-926e-ed829ac2179d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:03.974589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-f27094c8-bdc9-4878-926e-ed829ac2179d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:03.981475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f27094c8-bdc9-4878-926e-ed829ac2179d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:03.982081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f27094c8-bdc9-4878-926e-ed829ac2179d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:03.982792 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f27094c8-bdc9-4878-926e-ed829ac2179d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:03.983214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f27094c8-bdc9-4878-926e-ed829ac2179d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:04.205746 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e645944b-3222-4520-9bf1-f5ec9e11234a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:04.206240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e645944b-3222-4520-9bf1-f5ec9e11234a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:04.220955 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-f27094c8-bdc9-4878-926e-ed829ac2179d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:04.227949 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e645944b-3222-4520-9bf1-f5ec9e11234a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:04.227949 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e645944b-3222-4520-9bf1-f5ec9e11234a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:04.227949 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e645944b-3222-4520-9bf1-f5ec9e11234a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:04.227949 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e645944b-3222-4520-9bf1-f5ec9e11234a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:04.232236 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-f27094c8-bdc9-4878-926e-ed829ac2179d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1370 microversion: 2.1 time: 0.263165 Jul 14 14:33:04.239404 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 139/264] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:03 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1370 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:04.409647 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e645944b-3222-4520-9bf1-f5ec9e11234a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:04.420603 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e645944b-3222-4520-9bf1-f5ec9e11234a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1723 microversion: 2.1 time: 0.223469 Jul 14 14:33:04.421597 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 126/265] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:04 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:04.737903 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-af6eb610-e457-42da-a3a0-f3d5042c27ae tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:04.738990 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-af6eb610-e457-42da-a3a0-f3d5042c27ae tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:04.745446 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-af6eb610-e457-42da-a3a0-f3d5042c27ae tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:04.746012 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-af6eb610-e457-42da-a3a0-f3d5042c27ae tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:04.746880 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-af6eb610-e457-42da-a3a0-f3d5042c27ae tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:04.747381 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-af6eb610-e457-42da-a3a0-f3d5042c27ae tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:04.907910 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-af6eb610-e457-42da-a3a0-f3d5042c27ae tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:04.916197 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-af6eb610-e457-42da-a3a0-f3d5042c27ae tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1258 microversion: 2.1 time: 0.182533 Jul 14 14:33:04.916784 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 140/266] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:04 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1258 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:05.252140 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-9c04d88f-163c-48ab-a850-2ce8064f1065 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:05.253671 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-9c04d88f-163c-48ab-a850-2ce8064f1065 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:05.261477 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=4 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:05.262264 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=16 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:05.268391 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9c04d88f-163c-48ab-a850-2ce8064f1065 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:05.269374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9c04d88f-163c-48ab-a850-2ce8064f1065 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:05.270574 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9c04d88f-163c-48ab-a850-2ce8064f1065 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:05.271292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9c04d88f-163c-48ab-a850-2ce8064f1065 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:05.439412 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-25efb51f-2b18-4640-8bb6-08acf17499a7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:05.440335 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-25efb51f-2b18-4640-8bb6-08acf17499a7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:05.454425 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-25efb51f-2b18-4640-8bb6-08acf17499a7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:05.457938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-25efb51f-2b18-4640-8bb6-08acf17499a7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:05.457938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-25efb51f-2b18-4640-8bb6-08acf17499a7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:05.457938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-25efb51f-2b18-4640-8bb6-08acf17499a7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:05.606345 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=6 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:05.616401 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-9c04d88f-163c-48ab-a850-2ce8064f1065 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:05.633055 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-9c04d88f-163c-48ab-a850-2ce8064f1065 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1370 microversion: 2.1 time: 0.384838 Jul 14 14:33:05.633796 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 127/267] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:05 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1370 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:05.646322 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-25efb51f-2b18-4640-8bb6-08acf17499a7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:05.654436 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-25efb51f-2b18-4640-8bb6-08acf17499a7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1723 microversion: 2.1 time: 0.219614 Jul 14 14:33:05.655010 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 141/268] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:05 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:33:05.933409 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-2c70d7a5-b5c4-491f-b5db-cd89fcb10da5 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:05.934055 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-2c70d7a5-b5c4-491f-b5db-cd89fcb10da5 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:05.940070 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2c70d7a5-b5c4-491f-b5db-cd89fcb10da5 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:05.940508 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2c70d7a5-b5c4-491f-b5db-cd89fcb10da5 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:05.941255 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2c70d7a5-b5c4-491f-b5db-cd89fcb10da5 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:05.941677 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2c70d7a5-b5c4-491f-b5db-cd89fcb10da5 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:06.077521 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-2c70d7a5-b5c4-491f-b5db-cd89fcb10da5 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:06.089783 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-2c70d7a5-b5c4-491f-b5db-cd89fcb10da5 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1258 microversion: 2.1 time: 0.160490 Jul 14 14:33:06.099316 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 128/269] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:05 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:06.653800 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-eb6180a8-c71c-4d75-b109-8fb2f1f93f32 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:06.654557 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-eb6180a8-c71c-4d75-b109-8fb2f1f93f32 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:06.662018 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-eb6180a8-c71c-4d75-b109-8fb2f1f93f32 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:06.671081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-eb6180a8-c71c-4d75-b109-8fb2f1f93f32 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:06.671081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-eb6180a8-c71c-4d75-b109-8fb2f1f93f32 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:06.671081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-eb6180a8-c71c-4d75-b109-8fb2f1f93f32 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:06.676162 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-8a776a00-b33b-4bb8-9049-7fe970d8821d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:06.676899 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-8a776a00-b33b-4bb8-9049-7fe970d8821d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:06.685295 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8a776a00-b33b-4bb8-9049-7fe970d8821d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:06.685859 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8a776a00-b33b-4bb8-9049-7fe970d8821d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:06.686930 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8a776a00-b33b-4bb8-9049-7fe970d8821d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:06.687296 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8a776a00-b33b-4bb8-9049-7fe970d8821d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:06.908050 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-eb6180a8-c71c-4d75-b109-8fb2f1f93f32 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:06.914380 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-8a776a00-b33b-4bb8-9049-7fe970d8821d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:06.917638 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-eb6180a8-c71c-4d75-b109-8fb2f1f93f32 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1370 microversion: 2.1 time: 0.269735 Jul 14 14:33:06.917638 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 142/270] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:06 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1370 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:33:06.922374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-8a776a00-b33b-4bb8-9049-7fe970d8821d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1723 microversion: 2.1 time: 0.252584 Jul 14 14:33:06.922936 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 129/271] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:06 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:33:07.106903 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a182f6ec-713a-4078-a53b-f6589d305f48 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:07.107529 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a182f6ec-713a-4078-a53b-f6589d305f48 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:07.113961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a182f6ec-713a-4078-a53b-f6589d305f48 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:07.114504 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a182f6ec-713a-4078-a53b-f6589d305f48 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:07.115341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a182f6ec-713a-4078-a53b-f6589d305f48 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:07.115856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a182f6ec-713a-4078-a53b-f6589d305f48 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:07.265561 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a182f6ec-713a-4078-a53b-f6589d305f48 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:07.270695 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a182f6ec-713a-4078-a53b-f6589d305f48 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1258 microversion: 2.1 time: 0.167695 Jul 14 14:33:07.281233 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 143/272] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:07 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:07.933871 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-5c2e65fd-74af-4c4a-905a-e975dd0a77c1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:07.934660 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-5c2e65fd-74af-4c4a-905a-e975dd0a77c1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:07.939680 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-cb14de60-529d-43b7-824d-d08e5edd547c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:07.940279 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-cb14de60-529d-43b7-824d-d08e5edd547c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:07.941261 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5c2e65fd-74af-4c4a-905a-e975dd0a77c1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:07.941706 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5c2e65fd-74af-4c4a-905a-e975dd0a77c1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:07.942529 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5c2e65fd-74af-4c4a-905a-e975dd0a77c1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:07.942992 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5c2e65fd-74af-4c4a-905a-e975dd0a77c1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:07.947081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cb14de60-529d-43b7-824d-d08e5edd547c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:07.947517 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cb14de60-529d-43b7-824d-d08e5edd547c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:07.948386 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cb14de60-529d-43b7-824d-d08e5edd547c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:07.948811 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cb14de60-529d-43b7-824d-d08e5edd547c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:08.143529 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-5c2e65fd-74af-4c4a-905a-e975dd0a77c1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:08.152882 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-5c2e65fd-74af-4c4a-905a-e975dd0a77c1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1370 microversion: 2.1 time: 0.222931 Jul 14 14:33:08.153452 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 130/273] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:07 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1370 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:08.161916 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-cb14de60-529d-43b7-824d-d08e5edd547c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:08.170966 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-cb14de60-529d-43b7-824d-d08e5edd547c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1723 microversion: 2.1 time: 0.235021 Jul 14 14:33:08.171535 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 144/274] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:07 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:33:08.287703 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b5dd639d-f02a-4e48-8348-cff6e65c7dfa tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:08.288307 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b5dd639d-f02a-4e48-8348-cff6e65c7dfa tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:08.294965 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b5dd639d-f02a-4e48-8348-cff6e65c7dfa tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:08.295486 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b5dd639d-f02a-4e48-8348-cff6e65c7dfa tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:08.296244 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b5dd639d-f02a-4e48-8348-cff6e65c7dfa tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:08.296676 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b5dd639d-f02a-4e48-8348-cff6e65c7dfa tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:08.431431 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b5dd639d-f02a-4e48-8348-cff6e65c7dfa tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:08.438957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b5dd639d-f02a-4e48-8348-cff6e65c7dfa tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1258 microversion: 2.1 time: 0.155200 Jul 14 14:33:08.439520 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 131/275] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:08 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:09.169377 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-9930d87b-fa96-4c9f-9ea1-0c25cd7012d4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:09.170058 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-9930d87b-fa96-4c9f-9ea1-0c25cd7012d4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:09.176934 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9930d87b-fa96-4c9f-9ea1-0c25cd7012d4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:09.177371 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9930d87b-fa96-4c9f-9ea1-0c25cd7012d4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:09.178159 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9930d87b-fa96-4c9f-9ea1-0c25cd7012d4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:09.178586 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9930d87b-fa96-4c9f-9ea1-0c25cd7012d4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:09.188021 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-34581e71-9fc4-4947-b620-f0d73f449ce3 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:09.188616 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-34581e71-9fc4-4947-b620-f0d73f449ce3 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:09.194533 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-34581e71-9fc4-4947-b620-f0d73f449ce3 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:09.194970 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-34581e71-9fc4-4947-b620-f0d73f449ce3 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:09.196243 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-34581e71-9fc4-4947-b620-f0d73f449ce3 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:09.196709 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-34581e71-9fc4-4947-b620-f0d73f449ce3 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:09.385835 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-9930d87b-fa96-4c9f-9ea1-0c25cd7012d4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:09.392480 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-34581e71-9fc4-4947-b620-f0d73f449ce3 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:09.401023 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-9930d87b-fa96-4c9f-9ea1-0c25cd7012d4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1370 microversion: 2.1 time: 0.228093 Jul 14 14:33:09.401023 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 145/276] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:09 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1370 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:09.402520 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-34581e71-9fc4-4947-b620-f0d73f449ce3 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1723 microversion: 2.1 time: 0.218144 Jul 14 14:33:09.403091 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 132/277] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:09 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:33:09.455974 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c3922eba-3b05-4d45-ae88-b44d2e194b29 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:09.456567 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c3922eba-3b05-4d45-ae88-b44d2e194b29 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:09.462930 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c3922eba-3b05-4d45-ae88-b44d2e194b29 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:09.463373 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c3922eba-3b05-4d45-ae88-b44d2e194b29 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:09.467730 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c3922eba-3b05-4d45-ae88-b44d2e194b29 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:09.467730 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c3922eba-3b05-4d45-ae88-b44d2e194b29 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:09.601911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c3922eba-3b05-4d45-ae88-b44d2e194b29 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:09.605262 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=100 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:09.609848 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c3922eba-3b05-4d45-ae88-b44d2e194b29 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1258 microversion: 2.1 time: 0.157863 Jul 14 14:33:09.610409 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 146/278] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:09 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:10.411188 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e7759527-b6f9-4e01-8165-aaa73a879ae5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:10.411783 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e7759527-b6f9-4e01-8165-aaa73a879ae5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:10.418571 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e7759527-b6f9-4e01-8165-aaa73a879ae5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:10.419015 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e7759527-b6f9-4e01-8165-aaa73a879ae5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:10.419555 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ef455fab-6d0f-46a1-a4f4-fe636ff3987f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:10.420012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e7759527-b6f9-4e01-8165-aaa73a879ae5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:10.420203 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-ef455fab-6d0f-46a1-a4f4-fe636ff3987f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:10.420431 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e7759527-b6f9-4e01-8165-aaa73a879ae5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:10.427197 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ef455fab-6d0f-46a1-a4f4-fe636ff3987f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:10.427643 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ef455fab-6d0f-46a1-a4f4-fe636ff3987f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:10.428583 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ef455fab-6d0f-46a1-a4f4-fe636ff3987f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:10.429173 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ef455fab-6d0f-46a1-a4f4-fe636ff3987f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:10.634332 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e7759527-b6f9-4e01-8165-aaa73a879ae5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:10.637537 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-ef455fab-6d0f-46a1-a4f4-fe636ff3987f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:10.643300 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e7759527-b6f9-4e01-8165-aaa73a879ae5 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1370 microversion: 2.1 time: 0.235896 Jul 14 14:33:10.644152 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 133/279] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:10 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1370 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:10.646943 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-ef455fab-6d0f-46a1-a4f4-fe636ff3987f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1700 microversion: 2.1 time: 0.231377 Jul 14 14:33:10.647805 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 147/280] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:10 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1700 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:10.649489 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-32cdac77-defd-4e55-9909-aaa0f0191055 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:10.650116 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-32cdac77-defd-4e55-9909-aaa0f0191055 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:10.656169 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-32cdac77-defd-4e55-9909-aaa0f0191055 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:10.656603 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-32cdac77-defd-4e55-9909-aaa0f0191055 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:10.662915 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-32cdac77-defd-4e55-9909-aaa0f0191055 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:10.662915 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-32cdac77-defd-4e55-9909-aaa0f0191055 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:10.670622 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-81125aae-6ee8-44fe-9f66-0d1daa51eb84 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:10.676899 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-81125aae-6ee8-44fe-9f66-0d1daa51eb84 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:10.677343 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-81125aae-6ee8-44fe-9f66-0d1daa51eb84 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:10.751349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-81125aae-6ee8-44fe-9f66-0d1daa51eb84 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Going to try to start instance {{(pid=118461) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 14:33:10.813181 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-32cdac77-defd-4e55-9909-aaa0f0191055 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:10.821424 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-32cdac77-defd-4e55-9909-aaa0f0191055 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1258 microversion: 2.1 time: 0.176169 Jul 14 14:33:10.822054 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 134/281] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:10 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:10.993608 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-81125aae-6ee8-44fe-9f66-0d1daa51eb84 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "POST /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0/action" status: 202 len: 0 microversion: 2.1 time: 0.317418 Jul 14 14:33:10.994356 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 148/282] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 14 14:33:10 2022] POST /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:33:11.006918 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0a1575af-2b43-472e-9d58-45617cfddf77 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:11.008419 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0a1575af-2b43-472e-9d58-45617cfddf77 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:11.015392 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0a1575af-2b43-472e-9d58-45617cfddf77 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:11.016089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0a1575af-2b43-472e-9d58-45617cfddf77 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:11.017105 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0a1575af-2b43-472e-9d58-45617cfddf77 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:11.017659 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0a1575af-2b43-472e-9d58-45617cfddf77 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:11.179146 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-0a1575af-2b43-472e-9d58-45617cfddf77 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:11.189839 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0a1575af-2b43-472e-9d58-45617cfddf77 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1709 microversion: 2.1 time: 0.190830 Jul 14 14:33:11.200150 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 135/283] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:10 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1709 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:11.664623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-aa272f53-24c0-4cb2-b3fe-34b8f18e730a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:11.665300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-aa272f53-24c0-4cb2-b3fe-34b8f18e730a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:11.675398 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-aa272f53-24c0-4cb2-b3fe-34b8f18e730a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:11.679273 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-aa272f53-24c0-4cb2-b3fe-34b8f18e730a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:11.679273 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-aa272f53-24c0-4cb2-b3fe-34b8f18e730a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:11.679273 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-aa272f53-24c0-4cb2-b3fe-34b8f18e730a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:11.818455 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-aa272f53-24c0-4cb2-b3fe-34b8f18e730a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:11.826268 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-aa272f53-24c0-4cb2-b3fe-34b8f18e730a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1370 microversion: 2.1 time: 0.166375 Jul 14 14:33:11.826777 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 149/284] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:11 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:11.838655 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e72a6473-dbef-4987-8211-711a16d0ddd7 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:11.839795 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e72a6473-dbef-4987-8211-711a16d0ddd7 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:11.845355 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e72a6473-dbef-4987-8211-711a16d0ddd7 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:11.845827 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e72a6473-dbef-4987-8211-711a16d0ddd7 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:11.846583 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e72a6473-dbef-4987-8211-711a16d0ddd7 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:11.847017 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e72a6473-dbef-4987-8211-711a16d0ddd7 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:11.993560 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e72a6473-dbef-4987-8211-711a16d0ddd7 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:12.002290 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e72a6473-dbef-4987-8211-711a16d0ddd7 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1258 microversion: 2.1 time: 0.167745 Jul 14 14:33:12.006206 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 136/285] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:11 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:12.207715 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-3caa3146-c5b2-4329-bef3-1af500434519 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:12.208318 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-3caa3146-c5b2-4329-bef3-1af500434519 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:12.214876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3caa3146-c5b2-4329-bef3-1af500434519 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:12.215316 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3caa3146-c5b2-4329-bef3-1af500434519 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:12.216062 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3caa3146-c5b2-4329-bef3-1af500434519 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:12.216521 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3caa3146-c5b2-4329-bef3-1af500434519 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:12.344246 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3caa3146-c5b2-4329-bef3-1af500434519 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:12.352469 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-3caa3146-c5b2-4329-bef3-1af500434519 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1709 microversion: 2.1 time: 0.148538 Jul 14 14:33:12.353033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 150/286] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:12 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1709 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:12.844522 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-43aa1487-e502-41d7-bdfb-b05a1e86fa6e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:12.846975 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-43aa1487-e502-41d7-bdfb-b05a1e86fa6e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:12.853951 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-43aa1487-e502-41d7-bdfb-b05a1e86fa6e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:12.854879 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-43aa1487-e502-41d7-bdfb-b05a1e86fa6e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:12.859537 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-43aa1487-e502-41d7-bdfb-b05a1e86fa6e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:12.859537 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-43aa1487-e502-41d7-bdfb-b05a1e86fa6e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:12.996523 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-43aa1487-e502-41d7-bdfb-b05a1e86fa6e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:13.003923 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-43aa1487-e502-41d7-bdfb-b05a1e86fa6e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1370 microversion: 2.1 time: 0.163429 Jul 14 14:33:13.004483 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 137/287] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:12 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:13.024773 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-9e693b89-b7ba-493a-aab1-133bd01b1f6c tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:13.025390 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-9e693b89-b7ba-493a-aab1-133bd01b1f6c tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:13.031643 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9e693b89-b7ba-493a-aab1-133bd01b1f6c tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:13.032092 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9e693b89-b7ba-493a-aab1-133bd01b1f6c tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:13.032857 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9e693b89-b7ba-493a-aab1-133bd01b1f6c tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:13.033287 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9e693b89-b7ba-493a-aab1-133bd01b1f6c tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:13.169749 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-9e693b89-b7ba-493a-aab1-133bd01b1f6c tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:13.177384 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-9e693b89-b7ba-493a-aab1-133bd01b1f6c tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1258 microversion: 2.1 time: 0.161568 Jul 14 14:33:13.177980 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 151/288] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:13 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:13.370181 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-08febc6c-d9ea-47de-8f7d-42376d44b735 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:13.370705 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-08febc6c-d9ea-47de-8f7d-42376d44b735 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:13.376905 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-08febc6c-d9ea-47de-8f7d-42376d44b735 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:13.377343 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-08febc6c-d9ea-47de-8f7d-42376d44b735 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:13.378131 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-08febc6c-d9ea-47de-8f7d-42376d44b735 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:13.378559 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-08febc6c-d9ea-47de-8f7d-42376d44b735 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:13.511333 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-08febc6c-d9ea-47de-8f7d-42376d44b735 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:13.519625 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-08febc6c-d9ea-47de-8f7d-42376d44b735 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1709 microversion: 2.1 time: 0.153464 Jul 14 14:33:13.520193 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 138/289] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:13 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:14.029105 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b874551e-0688-475f-b81a-68bda907a35d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:14.029715 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b874551e-0688-475f-b81a-68bda907a35d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:14.036286 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b874551e-0688-475f-b81a-68bda907a35d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:14.036716 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b874551e-0688-475f-b81a-68bda907a35d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:14.044956 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b874551e-0688-475f-b81a-68bda907a35d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:14.044956 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b874551e-0688-475f-b81a-68bda907a35d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:14.175040 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b874551e-0688-475f-b81a-68bda907a35d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:14.183403 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b874551e-0688-475f-b81a-68bda907a35d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1370 microversion: 2.1 time: 0.158121 Jul 14 14:33:14.183971 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 152/290] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:14 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:33:14.194644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-8adb2190-1afb-4e25-8e83-be3e5533ee54 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:14.195825 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-8adb2190-1afb-4e25-8e83-be3e5533ee54 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:14.202118 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8adb2190-1afb-4e25-8e83-be3e5533ee54 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:14.202564 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8adb2190-1afb-4e25-8e83-be3e5533ee54 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:14.203400 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8adb2190-1afb-4e25-8e83-be3e5533ee54 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:14.203732 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8adb2190-1afb-4e25-8e83-be3e5533ee54 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:14.332829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-8adb2190-1afb-4e25-8e83-be3e5533ee54 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:14.340374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-8adb2190-1afb-4e25-8e83-be3e5533ee54 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1258 microversion: 2.1 time: 0.149771 Jul 14 14:33:14.341088 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 139/291] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:14 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:14.537489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-8dc48053-e6d9-4d91-86d4-e215ceb9941a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:14.538058 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-8dc48053-e6d9-4d91-86d4-e215ceb9941a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:14.544804 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8dc48053-e6d9-4d91-86d4-e215ceb9941a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:14.545792 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8dc48053-e6d9-4d91-86d4-e215ceb9941a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:14.546565 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8dc48053-e6d9-4d91-86d4-e215ceb9941a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:14.547005 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8dc48053-e6d9-4d91-86d4-e215ceb9941a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:14.679102 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-8dc48053-e6d9-4d91-86d4-e215ceb9941a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:14.688629 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-8dc48053-e6d9-4d91-86d4-e215ceb9941a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1709 microversion: 2.1 time: 0.155017 Jul 14 14:33:14.689214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 153/292] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:14 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1709 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:15.200119 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-608991d1-47e3-4b2d-a8a0-31e670d8b1b9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:15.200729 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-608991d1-47e3-4b2d-a8a0-31e670d8b1b9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:15.206806 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-608991d1-47e3-4b2d-a8a0-31e670d8b1b9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:15.207251 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-608991d1-47e3-4b2d-a8a0-31e670d8b1b9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:15.208005 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-608991d1-47e3-4b2d-a8a0-31e670d8b1b9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:15.208434 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-608991d1-47e3-4b2d-a8a0-31e670d8b1b9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:15.337632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-608991d1-47e3-4b2d-a8a0-31e670d8b1b9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:15.345305 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-608991d1-47e3-4b2d-a8a0-31e670d8b1b9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1370 microversion: 2.1 time: 0.149067 Jul 14 14:33:15.345892 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 140/293] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:15 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:15.357463 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-9a3eb6ca-5bf1-4e90-b582-9ffce880eaa1 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:15.358091 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-9a3eb6ca-5bf1-4e90-b582-9ffce880eaa1 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:15.364481 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9a3eb6ca-5bf1-4e90-b582-9ffce880eaa1 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:15.364921 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9a3eb6ca-5bf1-4e90-b582-9ffce880eaa1 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:15.365674 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9a3eb6ca-5bf1-4e90-b582-9ffce880eaa1 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:15.366126 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9a3eb6ca-5bf1-4e90-b582-9ffce880eaa1 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:15.500137 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-9a3eb6ca-5bf1-4e90-b582-9ffce880eaa1 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:15.508001 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-9a3eb6ca-5bf1-4e90-b582-9ffce880eaa1 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1258 microversion: 2.1 time: 0.154550 Jul 14 14:33:15.513009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 154/294] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:15 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:15.705286 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-6772396d-3bc2-4599-aabf-db54cabffa53 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:15.705933 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-6772396d-3bc2-4599-aabf-db54cabffa53 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:15.712652 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6772396d-3bc2-4599-aabf-db54cabffa53 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:15.713099 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6772396d-3bc2-4599-aabf-db54cabffa53 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:15.713894 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6772396d-3bc2-4599-aabf-db54cabffa53 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:15.714369 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6772396d-3bc2-4599-aabf-db54cabffa53 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:15.847021 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-6772396d-3bc2-4599-aabf-db54cabffa53 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:15.849225 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=100 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:15.856548 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-6772396d-3bc2-4599-aabf-db54cabffa53 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1713 microversion: 2.1 time: 0.155365 Jul 14 14:33:15.857123 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 141/295] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:15 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1713 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:16.362958 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ecacd182-127a-4c98-9ca5-0a94b7fa0e72 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:16.363498 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-ecacd182-127a-4c98-9ca5-0a94b7fa0e72 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:16.370010 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ecacd182-127a-4c98-9ca5-0a94b7fa0e72 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:16.370455 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ecacd182-127a-4c98-9ca5-0a94b7fa0e72 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:16.371233 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ecacd182-127a-4c98-9ca5-0a94b7fa0e72 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:16.371662 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ecacd182-127a-4c98-9ca5-0a94b7fa0e72 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:16.525985 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-6977ef49-6aca-442f-aceb-b82ce38810ef tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:16.526607 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-6977ef49-6aca-442f-aceb-b82ce38810ef tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:16.533117 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6977ef49-6aca-442f-aceb-b82ce38810ef tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:16.533565 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6977ef49-6aca-442f-aceb-b82ce38810ef tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:16.534456 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6977ef49-6aca-442f-aceb-b82ce38810ef tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:16.534893 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6977ef49-6aca-442f-aceb-b82ce38810ef tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:16.762382 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-ecacd182-127a-4c98-9ca5-0a94b7fa0e72 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:16.770027 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-ecacd182-127a-4c98-9ca5-0a94b7fa0e72 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1370 microversion: 2.1 time: 0.411020 Jul 14 14:33:16.770589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 155/296] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:16 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1370 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:16.795703 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-6977ef49-6aca-442f-aceb-b82ce38810ef tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:16.795703 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-6977ef49-6aca-442f-aceb-b82ce38810ef tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1258 microversion: 2.1 time: 0.274021 Jul 14 14:33:16.795966 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 142/297] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:16 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1258 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:33:16.944866 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-0b04e89c-8792-4cc8-9a93-4a9c0425f5a1 req-bb6d4c87-824f-4cfc-9098-efcf19428f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833f486d-a5d2-41ff-8404-19f21892e73c", "name": "network-vif-plugged", "status": "completed", "tag": "7f554063-5f76-4260-95f2-f9417cf2981a"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:16.954008 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-0b04e89c-8792-4cc8-9a93-4a9c0425f5a1 req-bb6d4c87-824f-4cfc-9098-efcf19428f95 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:16.954450 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-0b04e89c-8792-4cc8-9a93-4a9c0425f5a1 req-bb6d4c87-824f-4cfc-9098-efcf19428f95 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:16.965697 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-0b04e89c-8792-4cc8-9a93-4a9c0425f5a1 req-bb6d4c87-824f-4cfc-9098-efcf19428f95 service nova] Creating event network-vif-plugged:7f554063-5f76-4260-95f2-f9417cf2981a for instance 833f486d-a5d2-41ff-8404-19f21892e73c on hv-cinder-79987 Jul 14 14:33:16.971130 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-0b04e89c-8792-4cc8-9a93-4a9c0425f5a1 req-bb6d4c87-824f-4cfc-9098-efcf19428f95 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029978 Jul 14 14:33:16.973325 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 156/298] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:17.787635 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d3033216-dfe8-4625-844c-a39ea82ce5b1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:17.788237 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-d3033216-dfe8-4625-844c-a39ea82ce5b1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:17.794943 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d3033216-dfe8-4625-844c-a39ea82ce5b1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:17.795389 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d3033216-dfe8-4625-844c-a39ea82ce5b1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:17.796279 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d3033216-dfe8-4625-844c-a39ea82ce5b1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:17.796573 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d3033216-dfe8-4625-844c-a39ea82ce5b1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:17.813248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-5981e769-120c-4894-b4bd-f64c033628a6 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:17.815501 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-5981e769-120c-4894-b4bd-f64c033628a6 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:17.822393 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5981e769-120c-4894-b4bd-f64c033628a6 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:17.822843 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5981e769-120c-4894-b4bd-f64c033628a6 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:17.823641 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5981e769-120c-4894-b4bd-f64c033628a6 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:17.824077 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5981e769-120c-4894-b4bd-f64c033628a6 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:18.031577 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-d3033216-dfe8-4625-844c-a39ea82ce5b1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:18.043033 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-d3033216-dfe8-4625-844c-a39ea82ce5b1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1370 microversion: 2.1 time: 0.258812 Jul 14 14:33:18.044474 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 143/299] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:17 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:18.048597 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5981e769-120c-4894-b4bd-f64c033628a6 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:18.057037 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-5981e769-120c-4894-b4bd-f64c033628a6 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1258 microversion: 2.1 time: 0.248152 Jul 14 14:33:18.057986 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 157/300] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:17 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1258 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:33:18.987346 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-adedc601-c618-4cb9-9188-3d70ca05cc01 req-0f297355-371f-4c2d-88b7-33dad9630921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79f9504-35ca-452e-8c51-8db181ea74a7", "name": "network-vif-plugged", "status": "completed", "tag": "1aed1e1d-edb5-41ea-ac88-358515dbc3f6"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:18.998681 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-adedc601-c618-4cb9-9188-3d70ca05cc01 req-0f297355-371f-4c2d-88b7-33dad9630921 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:18.999128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-adedc601-c618-4cb9-9188-3d70ca05cc01 req-0f297355-371f-4c2d-88b7-33dad9630921 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:19.012264 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-adedc601-c618-4cb9-9188-3d70ca05cc01 req-0f297355-371f-4c2d-88b7-33dad9630921 service nova] Creating event network-vif-plugged:1aed1e1d-edb5-41ea-ac88-358515dbc3f6 for instance d79f9504-35ca-452e-8c51-8db181ea74a7 on hv-cinder-79987 Jul 14 14:33:19.019462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-adedc601-c618-4cb9-9188-3d70ca05cc01 req-0f297355-371f-4c2d-88b7-33dad9630921 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035916 Jul 14 14:33:19.024778 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 144/301] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:19.063440 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-369eeb4d-120c-4138-b8bd-66dda2cf6cee tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:19.064166 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-369eeb4d-120c-4138-b8bd-66dda2cf6cee tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:19.075063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-369eeb4d-120c-4138-b8bd-66dda2cf6cee tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:19.075898 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-369eeb4d-120c-4138-b8bd-66dda2cf6cee tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:19.077165 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-369eeb4d-120c-4138-b8bd-66dda2cf6cee tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:19.077595 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-369eeb4d-120c-4138-b8bd-66dda2cf6cee tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:19.106512 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-6b60d1d0-70c1-4cb5-8371-d14c4e1faf7a tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:19.107215 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-6b60d1d0-70c1-4cb5-8371-d14c4e1faf7a tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:19.113670 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6b60d1d0-70c1-4cb5-8371-d14c4e1faf7a tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:19.114359 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6b60d1d0-70c1-4cb5-8371-d14c4e1faf7a tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:19.115127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6b60d1d0-70c1-4cb5-8371-d14c4e1faf7a tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:19.115554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6b60d1d0-70c1-4cb5-8371-d14c4e1faf7a tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:19.359376 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-6b60d1d0-70c1-4cb5-8371-d14c4e1faf7a tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:19.369182 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-6b60d1d0-70c1-4cb5-8371-d14c4e1faf7a tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1258 microversion: 2.1 time: 0.281380 Jul 14 14:33:19.378631 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-369eeb4d-120c-4138-b8bd-66dda2cf6cee tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:19.384004 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 145/302] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:19 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1258 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:19.391153 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-369eeb4d-120c-4138-b8bd-66dda2cf6cee tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1370 microversion: 2.1 time: 0.332536 Jul 14 14:33:19.397089 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 158/303] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:19 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1370 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:20.392138 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b96c3f6c-fc44-4819-8a5a-d1623184d9ff tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:20.392760 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b96c3f6c-fc44-4819-8a5a-d1623184d9ff tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:20.399185 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b96c3f6c-fc44-4819-8a5a-d1623184d9ff tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:20.399881 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b96c3f6c-fc44-4819-8a5a-d1623184d9ff tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:20.400634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b96c3f6c-fc44-4819-8a5a-d1623184d9ff tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:20.401082 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b96c3f6c-fc44-4819-8a5a-d1623184d9ff tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:20.410807 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4f3e7815-01c3-4ac8-bb8b-7c3cc765b971 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:20.411410 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-4f3e7815-01c3-4ac8-bb8b-7c3cc765b971 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:20.417724 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f3e7815-01c3-4ac8-bb8b-7c3cc765b971 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:20.418211 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f3e7815-01c3-4ac8-bb8b-7c3cc765b971 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:20.419035 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f3e7815-01c3-4ac8-bb8b-7c3cc765b971 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:20.419464 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f3e7815-01c3-4ac8-bb8b-7c3cc765b971 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:20.624691 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b96c3f6c-fc44-4819-8a5a-d1623184d9ff tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:20.633419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4f3e7815-01c3-4ac8-bb8b-7c3cc765b971 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:20.633592 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b96c3f6c-fc44-4819-8a5a-d1623184d9ff tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1442 microversion: 2.1 time: 0.245854 Jul 14 14:33:20.634216 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 146/304] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:20 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1442 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:20.641449 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4f3e7815-01c3-4ac8-bb8b-7c3cc765b971 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1370 microversion: 2.1 time: 0.235043 Jul 14 14:33:20.642061 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 159/305] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:20 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1370 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:33:20.650255 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-af3b4b53-b67b-42ae-8603-3ebee3b88dab tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:20.650855 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-af3b4b53-b67b-42ae-8603-3ebee3b88dab tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:20.656862 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-af3b4b53-b67b-42ae-8603-3ebee3b88dab tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:20.657298 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-af3b4b53-b67b-42ae-8603-3ebee3b88dab tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:20.658069 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-af3b4b53-b67b-42ae-8603-3ebee3b88dab tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:20.658493 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-af3b4b53-b67b-42ae-8603-3ebee3b88dab tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:20.806764 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-af3b4b53-b67b-42ae-8603-3ebee3b88dab tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:20.814782 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-af3b4b53-b67b-42ae-8603-3ebee3b88dab tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1442 microversion: 2.1 time: 0.168330 Jul 14 14:33:20.817047 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 147/306] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:20 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1442 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:21.658464 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b54ae546-e714-46fd-8989-648800968a79 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:21.659214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b54ae546-e714-46fd-8989-648800968a79 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:21.667451 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b54ae546-e714-46fd-8989-648800968a79 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:21.667887 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b54ae546-e714-46fd-8989-648800968a79 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:21.668654 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b54ae546-e714-46fd-8989-648800968a79 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:21.669172 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b54ae546-e714-46fd-8989-648800968a79 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:21.937847 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b54ae546-e714-46fd-8989-648800968a79 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:21.945369 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b54ae546-e714-46fd-8989-648800968a79 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1370 microversion: 2.1 time: 0.290807 Jul 14 14:33:21.946018 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 160/307] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:21 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1370 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:22.963008 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-40ef10bc-f2e5-4334-b716-82dbe3e5e596 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:22.963920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-40ef10bc-f2e5-4334-b716-82dbe3e5e596 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:22.971199 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-40ef10bc-f2e5-4334-b716-82dbe3e5e596 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:22.971809 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-40ef10bc-f2e5-4334-b716-82dbe3e5e596 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:22.972988 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-40ef10bc-f2e5-4334-b716-82dbe3e5e596 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:22.973573 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-40ef10bc-f2e5-4334-b716-82dbe3e5e596 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:23.186179 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-40ef10bc-f2e5-4334-b716-82dbe3e5e596 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:23.193832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-40ef10bc-f2e5-4334-b716-82dbe3e5e596 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1370 microversion: 2.1 time: 0.235264 Jul 14 14:33:23.194575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 148/308] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:22 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1370 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:23.543115 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-faee11c4-fc06-4158-b71e-4e2ca13e2f45 req-515949d8-d75d-4c94-a033-7f67eadd744b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "833f486d-a5d2-41ff-8404-19f21892e73c", "tag": "7f554063-5f76-4260-95f2-f9417cf2981a"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:23.552702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-faee11c4-fc06-4158-b71e-4e2ca13e2f45 req-515949d8-d75d-4c94-a033-7f67eadd744b service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:23.553506 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-faee11c4-fc06-4158-b71e-4e2ca13e2f45 req-515949d8-d75d-4c94-a033-7f67eadd744b service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:23.565234 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-faee11c4-fc06-4158-b71e-4e2ca13e2f45 req-515949d8-d75d-4c94-a033-7f67eadd744b service nova] Creating event network-changed:7f554063-5f76-4260-95f2-f9417cf2981a for instance 833f486d-a5d2-41ff-8404-19f21892e73c on hv-cinder-79987 Jul 14 14:33:23.570780 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-faee11c4-fc06-4158-b71e-4e2ca13e2f45 req-515949d8-d75d-4c94-a033-7f67eadd744b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032735 Jul 14 14:33:23.571495 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 161/309] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:24.216636 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ca242151-a6a9-4606-9dd8-02a5aaf4e036 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:24.218735 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ca242151-a6a9-4606-9dd8-02a5aaf4e036 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:24.225277 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ca242151-a6a9-4606-9dd8-02a5aaf4e036 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:24.226082 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ca242151-a6a9-4606-9dd8-02a5aaf4e036 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:24.228118 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ca242151-a6a9-4606-9dd8-02a5aaf4e036 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:24.228711 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ca242151-a6a9-4606-9dd8-02a5aaf4e036 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:24.383798 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ca242151-a6a9-4606-9dd8-02a5aaf4e036 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:24.396472 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ca242151-a6a9-4606-9dd8-02a5aaf4e036 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1564 microversion: 2.1 time: 0.187749 Jul 14 14:33:24.397053 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 149/310] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:24 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1564 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:24.415384 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-9fbab4c8-87aa-496a-8f5c-afeb2e52b6a9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:24.416005 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-9fbab4c8-87aa-496a-8f5c-afeb2e52b6a9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:24.427294 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9fbab4c8-87aa-496a-8f5c-afeb2e52b6a9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:24.428399 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9fbab4c8-87aa-496a-8f5c-afeb2e52b6a9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:24.428743 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9fbab4c8-87aa-496a-8f5c-afeb2e52b6a9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:24.429170 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9fbab4c8-87aa-496a-8f5c-afeb2e52b6a9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:24.520233 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-9fbab4c8-87aa-496a-8f5c-afeb2e52b6a9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110049 Jul 14 14:33:24.521179 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 162/311] 10.222.0.93 () {58 vars in 1274 bytes} [Thu Jul 14 14:33:24 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:25.635589 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-54cf0457-e9fb-425f-a071-1f1faf954fe2 req-9979d24c-6f3a-4e2d-8091-605605450b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d79f9504-35ca-452e-8c51-8db181ea74a7", "tag": "1aed1e1d-edb5-41ea-ac88-358515dbc3f6"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:25.643819 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-54cf0457-e9fb-425f-a071-1f1faf954fe2 req-9979d24c-6f3a-4e2d-8091-605605450b0c service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:25.644259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-54cf0457-e9fb-425f-a071-1f1faf954fe2 req-9979d24c-6f3a-4e2d-8091-605605450b0c service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:25.658530 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-54cf0457-e9fb-425f-a071-1f1faf954fe2 req-9979d24c-6f3a-4e2d-8091-605605450b0c service nova] Creating event network-changed:1aed1e1d-edb5-41ea-ac88-358515dbc3f6 for instance d79f9504-35ca-452e-8c51-8db181ea74a7 on hv-cinder-79987 Jul 14 14:33:25.668125 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-54cf0457-e9fb-425f-a071-1f1faf954fe2 req-9979d24c-6f3a-4e2d-8091-605605450b0c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032583 Jul 14 14:33:25.668125 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 150/312] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:35.473568 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=53 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:35.474354 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:35.478465 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-22a47b22-a9c4-4763-b2ed-52891d981319 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1614239442", "imageRef": "7ea875a4-facb-4053-be2d-ff0080d2f3a0", "flavorRef": "452", "networks": [{"uuid": "db6609a6-02c2-495b-bdd0-7340fd7ba40c"}]}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:39.704694 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.network.neutron [None req-22a47b22-a9c4-4763-b2ed-52891d981319 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] validate_networks() for [('db6609a6-02c2-495b-bdd0-7340fd7ba40c', None, None, None, None, None)] {{(pid=118461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:33:40.267539 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-22a47b22-a9c4-4763-b2ed-52891d981319 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Flavor limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:33:40.267955 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-22a47b22-a9c4-4763-b2ed-52891d981319 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Image limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:33:40.268454 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-22a47b22-a9c4-4763-b2ed-52891d981319 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Flavor pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:33:40.268858 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-22a47b22-a9c4-4763-b2ed-52891d981319 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Image pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:33:40.269264 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-22a47b22-a9c4-4763-b2ed-52891d981319 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:33:40.281500 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-22a47b22-a9c4-4763-b2ed-52891d981319 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:40.281500 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-22a47b22-a9c4-4763-b2ed-52891d981319 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:40.281500 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-22a47b22-a9c4-4763-b2ed-52891d981319 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:40.281500 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-22a47b22-a9c4-4763-b2ed-52891d981319 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:40.302325 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-22a47b22-a9c4-4763-b2ed-52891d981319 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Getting quotas for project ceeb3ddff16645c6bd9ca8e138ed356f. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:33:40.306808 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-22a47b22-a9c4-4763-b2ed-52891d981319 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Getting quotas for user a1336e374bb542b7a036e3c0d0af54f3 and project ceeb3ddff16645c6bd9ca8e138ed356f. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:33:40.318083 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-22a47b22-a9c4-4763-b2ed-52891d981319 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Going to run 1 instances... {{(pid=118461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:33:40.320333 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-22a47b22-a9c4-4763-b2ed-52891d981319 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ea875a4-facb-4053-be2d-ff0080d2f3a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:33:40.484705 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-22a47b22-a9c4-4763-b2ed-52891d981319 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.012532 Jul 14 14:33:40.485353 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 163/313] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:33:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 5014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:33:40.496739 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-92bf503f-92bf-424a-a025-fbd3954e818e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:40.500978 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-92bf503f-92bf-424a-a025-fbd3954e818e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:40.500978 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=69 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:40.500978 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=47 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:40.558199 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-92bf503f-92bf-424a-a025-fbd3954e818e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:40.565682 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-92bf503f-92bf-424a-a025-fbd3954e818e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 200 len: 1219 microversion: 2.1 time: 0.073454 Jul 14 14:33:40.570186 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 151/314] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:40 2022] GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:41.583757 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a2d46f6b-50f7-47f4-86d9-8af1c62e43a9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:41.584396 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a2d46f6b-50f7-47f4-86d9-8af1c62e43a9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:41.592267 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a2d46f6b-50f7-47f4-86d9-8af1c62e43a9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:41.592714 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a2d46f6b-50f7-47f4-86d9-8af1c62e43a9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:41.593468 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a2d46f6b-50f7-47f4-86d9-8af1c62e43a9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:41.593937 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a2d46f6b-50f7-47f4-86d9-8af1c62e43a9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:41.657233 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a2d46f6b-50f7-47f4-86d9-8af1c62e43a9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:41.665591 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a2d46f6b-50f7-47f4-86d9-8af1c62e43a9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 200 len: 1223 microversion: 2.1 time: 0.085700 Jul 14 14:33:41.666190 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 164/315] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:41 2022] GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:42.683167 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-324de149-f930-491c-8ca9-163b93a8c4a2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:42.684730 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-324de149-f930-491c-8ca9-163b93a8c4a2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:42.692649 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-324de149-f930-491c-8ca9-163b93a8c4a2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:42.693453 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-324de149-f930-491c-8ca9-163b93a8c4a2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:42.694057 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-324de149-f930-491c-8ca9-163b93a8c4a2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:42.694619 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-324de149-f930-491c-8ca9-163b93a8c4a2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:42.761062 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-324de149-f930-491c-8ca9-163b93a8c4a2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:42.768556 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-324de149-f930-491c-8ca9-163b93a8c4a2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 200 len: 1279 microversion: 2.1 time: 0.090049 Jul 14 14:33:42.778528 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 152/316] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:42 2022] GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:43.786203 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-194286ee-9d0d-4a78-a105-7cec755dc136 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:43.786798 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-194286ee-9d0d-4a78-a105-7cec755dc136 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:43.793707 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-194286ee-9d0d-4a78-a105-7cec755dc136 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:43.794172 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-194286ee-9d0d-4a78-a105-7cec755dc136 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:43.794960 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-194286ee-9d0d-4a78-a105-7cec755dc136 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:43.795383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-194286ee-9d0d-4a78-a105-7cec755dc136 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:43.929788 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-194286ee-9d0d-4a78-a105-7cec755dc136 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:43.937424 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-194286ee-9d0d-4a78-a105-7cec755dc136 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 200 len: 1319 microversion: 2.1 time: 0.155253 Jul 14 14:33:43.938029 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 165/317] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:43 2022] GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:44.760137 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-05631f75-08be-4802-8a48-0150de2640fa req-688fd8a2-9603-4367-ba38-b4e31b51e6ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a74f940-a1d9-415c-a5ef-122576dd9e54", "tag": "5fca55be-c0f3-4146-b3bb-58ac04b68e9e"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:44.769980 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-05631f75-08be-4802-8a48-0150de2640fa req-688fd8a2-9603-4367-ba38-b4e31b51e6ba service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:44.770422 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-05631f75-08be-4802-8a48-0150de2640fa req-688fd8a2-9603-4367-ba38-b4e31b51e6ba service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:44.781312 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-05631f75-08be-4802-8a48-0150de2640fa req-688fd8a2-9603-4367-ba38-b4e31b51e6ba service nova] Creating event network-changed:5fca55be-c0f3-4146-b3bb-58ac04b68e9e for instance 9a74f940-a1d9-415c-a5ef-122576dd9e54 on hv-cinder-79987 Jul 14 14:33:44.786210 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-05631f75-08be-4802-8a48-0150de2640fa req-688fd8a2-9603-4367-ba38-b4e31b51e6ba service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030016 Jul 14 14:33:44.786806 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 153/318] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:44.953964 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-25410d63-b519-42c5-b43c-ead33848e958 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:44.954750 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-25410d63-b519-42c5-b43c-ead33848e958 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:44.961406 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-25410d63-b519-42c5-b43c-ead33848e958 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:44.962331 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-25410d63-b519-42c5-b43c-ead33848e958 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:44.962806 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-25410d63-b519-42c5-b43c-ead33848e958 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:44.963238 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-25410d63-b519-42c5-b43c-ead33848e958 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:45.107061 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-25410d63-b519-42c5-b43c-ead33848e958 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:45.114646 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-25410d63-b519-42c5-b43c-ead33848e958 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 200 len: 1319 microversion: 2.1 time: 0.164722 Jul 14 14:33:45.115372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 166/319] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:44 2022] GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:46.132509 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-acf9ed23-1da0-43c4-ab53-4b6dbe119f42 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:46.133199 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-acf9ed23-1da0-43c4-ab53-4b6dbe119f42 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:46.139690 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-acf9ed23-1da0-43c4-ab53-4b6dbe119f42 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:46.140125 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-acf9ed23-1da0-43c4-ab53-4b6dbe119f42 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:46.140861 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-acf9ed23-1da0-43c4-ab53-4b6dbe119f42 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:46.141283 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-acf9ed23-1da0-43c4-ab53-4b6dbe119f42 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:46.270075 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-acf9ed23-1da0-43c4-ab53-4b6dbe119f42 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:46.278144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-acf9ed23-1da0-43c4-ab53-4b6dbe119f42 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 200 len: 1319 microversion: 2.1 time: 0.149890 Jul 14 14:33:46.278714 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 154/320] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:46 2022] GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:47.301557 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-be77215f-f5a5-4bc1-9389-2b768b8739c2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:47.301557 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-be77215f-f5a5-4bc1-9389-2b768b8739c2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:47.302608 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-be77215f-f5a5-4bc1-9389-2b768b8739c2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:47.303046 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-be77215f-f5a5-4bc1-9389-2b768b8739c2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:47.303790 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-be77215f-f5a5-4bc1-9389-2b768b8739c2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:47.304767 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-be77215f-f5a5-4bc1-9389-2b768b8739c2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:47.433664 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-be77215f-f5a5-4bc1-9389-2b768b8739c2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:47.441282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-be77215f-f5a5-4bc1-9389-2b768b8739c2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 200 len: 1319 microversion: 2.1 time: 0.149773 Jul 14 14:33:47.441871 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 167/321] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:47 2022] GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:48.458665 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-55ee10b2-5797-429b-83c3-3b00c52fdcdb tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:48.459262 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-55ee10b2-5797-429b-83c3-3b00c52fdcdb tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:48.466347 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-55ee10b2-5797-429b-83c3-3b00c52fdcdb tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:48.466794 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-55ee10b2-5797-429b-83c3-3b00c52fdcdb tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:48.467551 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-55ee10b2-5797-429b-83c3-3b00c52fdcdb tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:48.468149 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-55ee10b2-5797-429b-83c3-3b00c52fdcdb tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:48.607520 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-55ee10b2-5797-429b-83c3-3b00c52fdcdb tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:48.614929 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-55ee10b2-5797-429b-83c3-3b00c52fdcdb tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 200 len: 1319 microversion: 2.1 time: 0.160310 Jul 14 14:33:48.615492 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 155/322] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:48 2022] GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:49.632026 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4693b825-b3ba-4dff-99ea-b6056821a5df tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:49.632634 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-4693b825-b3ba-4dff-99ea-b6056821a5df tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:49.639182 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4693b825-b3ba-4dff-99ea-b6056821a5df tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:49.639618 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4693b825-b3ba-4dff-99ea-b6056821a5df tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:49.640397 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4693b825-b3ba-4dff-99ea-b6056821a5df tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:49.640823 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4693b825-b3ba-4dff-99ea-b6056821a5df tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:49.782645 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4693b825-b3ba-4dff-99ea-b6056821a5df tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:49.790674 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4693b825-b3ba-4dff-99ea-b6056821a5df tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 200 len: 1319 microversion: 2.1 time: 0.162496 Jul 14 14:33:49.791400 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 168/323] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:49 2022] GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:50.809820 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0b57009a-c6ce-4a1b-a885-ab56bdfc329e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:50.810338 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0b57009a-c6ce-4a1b-a885-ab56bdfc329e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:50.815489 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=2 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:50.817988 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0b57009a-c6ce-4a1b-a885-ab56bdfc329e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:50.818436 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0b57009a-c6ce-4a1b-a885-ab56bdfc329e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:50.819231 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0b57009a-c6ce-4a1b-a885-ab56bdfc329e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:50.820235 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0b57009a-c6ce-4a1b-a885-ab56bdfc329e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:50.961079 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-0b57009a-c6ce-4a1b-a885-ab56bdfc329e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:50.969138 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0b57009a-c6ce-4a1b-a885-ab56bdfc329e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 200 len: 1319 microversion: 2.1 time: 0.163512 Jul 14 14:33:50.969720 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 156/324] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:50 2022] GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:51.985443 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-6ed063f7-470e-45a8-82c4-7ffacd3f90b9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:51.986170 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-6ed063f7-470e-45a8-82c4-7ffacd3f90b9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:51.987875 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:51.988595 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=6 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:51.993885 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6ed063f7-470e-45a8-82c4-7ffacd3f90b9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:51.994324 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6ed063f7-470e-45a8-82c4-7ffacd3f90b9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:51.995066 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6ed063f7-470e-45a8-82c4-7ffacd3f90b9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:51.995520 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6ed063f7-470e-45a8-82c4-7ffacd3f90b9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:52.127651 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-6ed063f7-470e-45a8-82c4-7ffacd3f90b9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:52.135677 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-6ed063f7-470e-45a8-82c4-7ffacd3f90b9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 200 len: 1319 microversion: 2.1 time: 0.154342 Jul 14 14:33:52.136257 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 169/325] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:51 2022] GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:53.153088 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-00ac6502-0cf7-46ce-83f7-f60c6c025775 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:53.153603 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-00ac6502-0cf7-46ce-83f7-f60c6c025775 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:53.159653 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-00ac6502-0cf7-46ce-83f7-f60c6c025775 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:53.160126 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-00ac6502-0cf7-46ce-83f7-f60c6c025775 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:53.160866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-00ac6502-0cf7-46ce-83f7-f60c6c025775 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:53.161351 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-00ac6502-0cf7-46ce-83f7-f60c6c025775 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:53.289681 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-1a675b54-37f9-4dc4-8bee-384a5b5a35b1 req-0d3a438d-59ad-4dcd-bd08-7239d7c08c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a74f940-a1d9-415c-a5ef-122576dd9e54", "name": "network-vif-plugged", "status": "completed", "tag": "5fca55be-c0f3-4146-b3bb-58ac04b68e9e"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:33:53.309667 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-00ac6502-0cf7-46ce-83f7-f60c6c025775 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:53.311090 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-1a675b54-37f9-4dc4-8bee-384a5b5a35b1 req-0d3a438d-59ad-4dcd-bd08-7239d7c08c42 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:53.314304 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-1a675b54-37f9-4dc4-8bee-384a5b5a35b1 req-0d3a438d-59ad-4dcd-bd08-7239d7c08c42 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:53.323709 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-1a675b54-37f9-4dc4-8bee-384a5b5a35b1 req-0d3a438d-59ad-4dcd-bd08-7239d7c08c42 service nova] Creating event network-vif-plugged:5fca55be-c0f3-4146-b3bb-58ac04b68e9e for instance 9a74f940-a1d9-415c-a5ef-122576dd9e54 on hv-cinder-79987 Jul 14 14:33:53.324638 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-00ac6502-0cf7-46ce-83f7-f60c6c025775 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 200 len: 1319 microversion: 2.1 time: 0.175424 Jul 14 14:33:53.325174 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 157/326] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:53 2022] GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:53.328805 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-1a675b54-37f9-4dc4-8bee-384a5b5a35b1 req-0d3a438d-59ad-4dcd-bd08-7239d7c08c42 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045254 Jul 14 14:33:53.329395 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 170/327] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:54.343270 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-da41ae8e-5d1a-4645-8eea-ced79a9515ec tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:54.343863 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-da41ae8e-5d1a-4645-8eea-ced79a9515ec tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:54.349824 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-da41ae8e-5d1a-4645-8eea-ced79a9515ec tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:54.350235 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-da41ae8e-5d1a-4645-8eea-ced79a9515ec tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:54.351490 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-da41ae8e-5d1a-4645-8eea-ced79a9515ec tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:54.351921 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-da41ae8e-5d1a-4645-8eea-ced79a9515ec tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:54.485894 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-da41ae8e-5d1a-4645-8eea-ced79a9515ec tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:54.493899 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-da41ae8e-5d1a-4645-8eea-ced79a9515ec tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 200 len: 1319 microversion: 2.1 time: 0.154446 Jul 14 14:33:54.494405 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 158/328] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:54 2022] GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:55.511773 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-54df2124-46ec-4cff-8d8e-6432c2cf9abf tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:55.512452 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-54df2124-46ec-4cff-8d8e-6432c2cf9abf tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:55.519004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-54df2124-46ec-4cff-8d8e-6432c2cf9abf tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:55.519445 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-54df2124-46ec-4cff-8d8e-6432c2cf9abf tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:55.520196 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-54df2124-46ec-4cff-8d8e-6432c2cf9abf tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:55.520617 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-54df2124-46ec-4cff-8d8e-6432c2cf9abf tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:55.659597 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-54df2124-46ec-4cff-8d8e-6432c2cf9abf tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:55.668687 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-54df2124-46ec-4cff-8d8e-6432c2cf9abf tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 200 len: 1319 microversion: 2.1 time: 0.161735 Jul 14 14:33:55.671782 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 171/329] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:55 2022] GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:56.686232 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ecbbf394-6442-402f-8e69-985da3d72225 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:56.686775 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ecbbf394-6442-402f-8e69-985da3d72225 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:33:56.693277 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ecbbf394-6442-402f-8e69-985da3d72225 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:56.693722 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ecbbf394-6442-402f-8e69-985da3d72225 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:56.695445 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ecbbf394-6442-402f-8e69-985da3d72225 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:56.695923 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ecbbf394-6442-402f-8e69-985da3d72225 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:56.833456 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ecbbf394-6442-402f-8e69-985da3d72225 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:33:56.842311 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ecbbf394-6442-402f-8e69-985da3d72225 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 200 len: 1508 microversion: 2.1 time: 0.159951 Jul 14 14:33:56.846856 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 159/330] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:33:56 2022] GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:06.700902 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-bde1b02a-61f2-4855-8864-3cfdb4c76052 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-108324088", "imageRef": "7ea875a4-facb-4053-be2d-ff0080d2f3a0", "flavorRef": "452"}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:06.714205 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:06.714994 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=46 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:06.786058 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.network.neutron [None req-bde1b02a-61f2-4855-8864-3cfdb4c76052 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] validate_networks() for None {{(pid=118461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:34:07.263505 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-cf5c68a1-3684-4b38-bf8f-1855e705fc64 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:07.264082 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-cf5c68a1-3684-4b38-bf8f-1855e705fc64 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:07.291849 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=20 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:07.294146 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=44 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:07.296927 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cf5c68a1-3684-4b38-bf8f-1855e705fc64 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:07.297804 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cf5c68a1-3684-4b38-bf8f-1855e705fc64 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:07.298583 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cf5c68a1-3684-4b38-bf8f-1855e705fc64 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:07.299021 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cf5c68a1-3684-4b38-bf8f-1855e705fc64 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:07.398772 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-bde1b02a-61f2-4855-8864-3cfdb4c76052 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Flavor limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:34:07.399264 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-bde1b02a-61f2-4855-8864-3cfdb4c76052 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Image limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:34:07.399865 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-bde1b02a-61f2-4855-8864-3cfdb4c76052 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Flavor pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:34:07.400395 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-bde1b02a-61f2-4855-8864-3cfdb4c76052 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Image pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:34:07.400879 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-bde1b02a-61f2-4855-8864-3cfdb4c76052 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:34:07.413913 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bde1b02a-61f2-4855-8864-3cfdb4c76052 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:07.414874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bde1b02a-61f2-4855-8864-3cfdb4c76052 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:07.416044 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bde1b02a-61f2-4855-8864-3cfdb4c76052 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:07.417177 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bde1b02a-61f2-4855-8864-3cfdb4c76052 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:07.442583 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-bde1b02a-61f2-4855-8864-3cfdb4c76052 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Getting quotas for project 50add55111c4427d94f06a3cf0555067. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:34:07.447244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-bde1b02a-61f2-4855-8864-3cfdb4c76052 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Getting quotas for user 4108ab2452684c819e93dabd4f9e7c98 and project 50add55111c4427d94f06a3cf0555067. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:34:07.470807 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-bde1b02a-61f2-4855-8864-3cfdb4c76052 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Going to run 1 instances... {{(pid=118461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:34:07.473370 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-bde1b02a-61f2-4855-8864-3cfdb4c76052 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ea875a4-facb-4053-be2d-ff0080d2f3a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:34:07.515872 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-cf5c68a1-3684-4b38-bf8f-1855e705fc64 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lazy-loading 'services' on Instance uuid 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:34:07.626689 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-bde1b02a-61f2-4855-8864-3cfdb4c76052 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.931888 Jul 14 14:34:07.630013 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 172/331] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:34:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:34:07.643425 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-fcec52f6-1d38-4cb2-acdd-6f7bd23b0f16 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:07.644175 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-fcec52f6-1d38-4cb2-acdd-6f7bd23b0f16 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:07.725223 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-fcec52f6-1d38-4cb2-acdd-6f7bd23b0f16 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:07.740828 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-fcec52f6-1d38-4cb2-acdd-6f7bd23b0f16 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1214 microversion: 2.1 time: 0.101426 Jul 14 14:34:07.741415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 173/332] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:07 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:07.827671 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-cf5c68a1-3684-4b38-bf8f-1855e705fc64 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "DELETE /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0/os-volume_attachments/98350bfd-8ab6-4ef3-8ea9-1e179e8d9d5a" status: 202 len: 0 microversion: 2.1 time: 0.569319 Jul 14 14:34:07.832825 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 160/333] 10.222.0.93 () {58 vars in 1415 bytes} [Thu Jul 14 14:34:07 2022] DELETE /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0/os-volume_attachments/98350bfd-8ab6-4ef3-8ea9-1e179e8d9d5a => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:34:08.761083 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-7f93fd07-a657-4a99-b98c-41ffe4d0ee6e tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:08.762165 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-7f93fd07-a657-4a99-b98c-41ffe4d0ee6e tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:08.828417 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7f93fd07-a657-4a99-b98c-41ffe4d0ee6e tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:08.842277 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-7f93fd07-a657-4a99-b98c-41ffe4d0ee6e tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1214 microversion: 2.1 time: 0.084847 Jul 14 14:34:08.843099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 174/334] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:08 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:09.864296 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-01622141-a2fc-403d-8d88-387b346189a5 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:09.865607 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-01622141-a2fc-403d-8d88-387b346189a5 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:09.874066 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-01622141-a2fc-403d-8d88-387b346189a5 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:09.874306 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-01622141-a2fc-403d-8d88-387b346189a5 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:09.874919 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-01622141-a2fc-403d-8d88-387b346189a5 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:09.875344 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-01622141-a2fc-403d-8d88-387b346189a5 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:09.965016 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-01622141-a2fc-403d-8d88-387b346189a5 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:09.973830 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-01622141-a2fc-403d-8d88-387b346189a5 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1218 microversion: 2.1 time: 0.117668 Jul 14 14:34:09.974672 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 161/335] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:09 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:10.997923 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-2c2ad87d-055e-4269-8e51-e281b0dbeddc tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:10.998579 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-2c2ad87d-055e-4269-8e51-e281b0dbeddc tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:11.005850 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2c2ad87d-055e-4269-8e51-e281b0dbeddc tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:11.006295 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2c2ad87d-055e-4269-8e51-e281b0dbeddc tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:11.007123 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2c2ad87d-055e-4269-8e51-e281b0dbeddc tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:11.007547 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2c2ad87d-055e-4269-8e51-e281b0dbeddc tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:11.087736 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-2c2ad87d-055e-4269-8e51-e281b0dbeddc tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:11.096601 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-2c2ad87d-055e-4269-8e51-e281b0dbeddc tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1218 microversion: 2.1 time: 0.108484 Jul 14 14:34:11.099547 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 175/336] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:10 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:12.124397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-fa8cd179-c363-4303-92b5-4de11cd62228 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:12.125714 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-fa8cd179-c363-4303-92b5-4de11cd62228 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:12.143128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fa8cd179-c363-4303-92b5-4de11cd62228 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:12.143526 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fa8cd179-c363-4303-92b5-4de11cd62228 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:12.144316 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fa8cd179-c363-4303-92b5-4de11cd62228 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:12.144749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fa8cd179-c363-4303-92b5-4de11cd62228 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:12.219520 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-fa8cd179-c363-4303-92b5-4de11cd62228 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:12.228083 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-fa8cd179-c363-4303-92b5-4de11cd62228 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1218 microversion: 2.1 time: 0.115615 Jul 14 14:34:12.228967 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 162/337] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:12 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:12.932303 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d8eed7c0-834f-40c3-8f13-2b06385349fc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62a73395-7cf6-4783-a5ed-e5208ff733f8"}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:12.934265 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d8eed7c0-834f-40c3-8f13-2b06385349fc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:12.942296 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d8eed7c0-834f-40c3-8f13-2b06385349fc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:12.943500 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d8eed7c0-834f-40c3-8f13-2b06385349fc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:12.944639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d8eed7c0-834f-40c3-8f13-2b06385349fc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:12.945921 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d8eed7c0-834f-40c3-8f13-2b06385349fc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:13.245885 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0489a6ab-3afd-46b6-a4ef-2c6f5bb2c67a tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:13.247579 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0489a6ab-3afd-46b6-a4ef-2c6f5bb2c67a tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:13.255782 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0489a6ab-3afd-46b6-a4ef-2c6f5bb2c67a tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:13.259988 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0489a6ab-3afd-46b6-a4ef-2c6f5bb2c67a tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:13.259988 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0489a6ab-3afd-46b6-a4ef-2c6f5bb2c67a tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:13.259988 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0489a6ab-3afd-46b6-a4ef-2c6f5bb2c67a tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:13.359226 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-0489a6ab-3afd-46b6-a4ef-2c6f5bb2c67a tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:13.369009 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0489a6ab-3afd-46b6-a4ef-2c6f5bb2c67a tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1218 microversion: 2.1 time: 0.128229 Jul 14 14:34:13.371625 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 163/338] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:13 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1218 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:14.361495 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b08bd87d-a01a-4e9b-9cad-8ee35b34b277 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:14.369107 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b08bd87d-a01a-4e9b-9cad-8ee35b34b277 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:14.369637 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b08bd87d-a01a-4e9b-9cad-8ee35b34b277 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:14.400119 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b08bd87d-a01a-4e9b-9cad-8ee35b34b277 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Going to try to stop instance {{(pid=118462) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 14:34:14.512110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d8eed7c0-834f-40c3-8f13-2b06385349fc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "POST /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.590151 Jul 14 14:34:14.512854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 176/339] 10.222.0.93 () {60 vars in 1322 bytes} [Thu Jul 14 14:34:12 2022] POST /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/os-volume_attachments => generated 194 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:14.552594 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-89546d1e-a356-4e21-9c4f-4f98a6e730a2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:14.552594 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-89546d1e-a356-4e21-9c4f-4f98a6e730a2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:14.552594 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-89546d1e-a356-4e21-9c4f-4f98a6e730a2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:14.552594 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-89546d1e-a356-4e21-9c4f-4f98a6e730a2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:14.552907 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-89546d1e-a356-4e21-9c4f-4f98a6e730a2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:14.552907 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-89546d1e-a356-4e21-9c4f-4f98a6e730a2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:14.606202 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-89546d1e-a356-4e21-9c4f-4f98a6e730a2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:14.613678 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-89546d1e-a356-4e21-9c4f-4f98a6e730a2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1266 microversion: 2.1 time: 0.099599 Jul 14 14:34:14.614278 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 177/340] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:14 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:14.927257 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-533aaaac-8566-4803-8105-3b8e277dd05c tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9647ba3e-8b35-4c03-926a-ba03ea6948fc", "device": "/dev/sdb"}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:14.932013 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-533aaaac-8566-4803-8105-3b8e277dd05c tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:14.941235 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-533aaaac-8566-4803-8105-3b8e277dd05c tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:14.941677 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-533aaaac-8566-4803-8105-3b8e277dd05c tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:14.942470 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-533aaaac-8566-4803-8105-3b8e277dd05c tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:14.942885 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-533aaaac-8566-4803-8105-3b8e277dd05c tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:15.200571 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b08bd87d-a01a-4e9b-9cad-8ee35b34b277 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "POST /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0/action" status: 202 len: 0 microversion: 2.1 time: 0.842952 Jul 14 14:34:15.205616 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 164/341] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 14 14:34:14 2022] POST /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0/action => generated 0 bytes in 848 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:34:15.218457 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-190297b3-97ee-4035-825a-70bbc941c5af tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:15.219646 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-190297b3-97ee-4035-825a-70bbc941c5af tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:15.248383 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-190297b3-97ee-4035-825a-70bbc941c5af tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:15.255901 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-190297b3-97ee-4035-825a-70bbc941c5af tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:15.257017 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-190297b3-97ee-4035-825a-70bbc941c5af tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:15.257621 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-190297b3-97ee-4035-825a-70bbc941c5af tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:15.461984 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-190297b3-97ee-4035-825a-70bbc941c5af tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:15.472851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-190297b3-97ee-4035-825a-70bbc941c5af tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1677 microversion: 2.1 time: 0.263177 Jul 14 14:34:15.473688 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 165/342] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:15 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1677 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:15.637240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ce7dd0b3-9508-4f68-befa-112264431679 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:15.638429 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ce7dd0b3-9508-4f68-befa-112264431679 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:15.649248 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ce7dd0b3-9508-4f68-befa-112264431679 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:15.650320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ce7dd0b3-9508-4f68-befa-112264431679 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:15.651371 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ce7dd0b3-9508-4f68-befa-112264431679 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:15.652031 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ce7dd0b3-9508-4f68-befa-112264431679 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:15.758116 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ce7dd0b3-9508-4f68-befa-112264431679 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:15.769555 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ce7dd0b3-9508-4f68-befa-112264431679 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1284 microversion: 2.1 time: 0.136996 Jul 14 14:34:15.771278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 166/343] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:15 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:15.858188 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-533aaaac-8566-4803-8105-3b8e277dd05c tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "POST /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.943017 Jul 14 14:34:15.859912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 178/344] 10.222.0.93 () {60 vars in 1322 bytes} [Thu Jul 14 14:34:14 2022] POST /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54/os-volume_attachments => generated 194 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:34:16.105650 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 14:34:16.106569 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Thu Jul 14 14:34:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 14:34:16.493381 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-54d9e490-1ed2-44ff-8c38-aabec0bf588e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:16.494003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-54d9e490-1ed2-44ff-8c38-aabec0bf588e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:16.501287 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-54d9e490-1ed2-44ff-8c38-aabec0bf588e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:16.502164 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-54d9e490-1ed2-44ff-8c38-aabec0bf588e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:16.503164 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-54d9e490-1ed2-44ff-8c38-aabec0bf588e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:16.503590 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-54d9e490-1ed2-44ff-8c38-aabec0bf588e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:16.692739 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-54d9e490-1ed2-44ff-8c38-aabec0bf588e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:16.701403 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-54d9e490-1ed2-44ff-8c38-aabec0bf588e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1677 microversion: 2.1 time: 0.214149 Jul 14 14:34:16.713359 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 167/345] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:16 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1677 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:16.801589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c2606461-b69a-4ae1-b5c3-0a76f60ee8cc tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:16.802337 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c2606461-b69a-4ae1-b5c3-0a76f60ee8cc tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:16.809584 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c2606461-b69a-4ae1-b5c3-0a76f60ee8cc tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:16.810071 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c2606461-b69a-4ae1-b5c3-0a76f60ee8cc tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:16.811428 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c2606461-b69a-4ae1-b5c3-0a76f60ee8cc tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:16.811428 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c2606461-b69a-4ae1-b5c3-0a76f60ee8cc tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:16.985742 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c2606461-b69a-4ae1-b5c3-0a76f60ee8cc tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:16.996283 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c2606461-b69a-4ae1-b5c3-0a76f60ee8cc tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1314 microversion: 2.1 time: 0.201103 Jul 14 14:34:16.996989 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 179/346] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:16 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:17.720922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ae73c13b-e1d7-4ebe-9db5-a76ce14dff33 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:17.722119 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ae73c13b-e1d7-4ebe-9db5-a76ce14dff33 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:17.737020 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ae73c13b-e1d7-4ebe-9db5-a76ce14dff33 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:17.737734 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ae73c13b-e1d7-4ebe-9db5-a76ce14dff33 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:17.738717 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ae73c13b-e1d7-4ebe-9db5-a76ce14dff33 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:17.739318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ae73c13b-e1d7-4ebe-9db5-a76ce14dff33 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:17.928813 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ae73c13b-e1d7-4ebe-9db5-a76ce14dff33 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:17.943252 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ae73c13b-e1d7-4ebe-9db5-a76ce14dff33 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1677 microversion: 2.1 time: 0.225793 Jul 14 14:34:17.944619 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 168/347] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:17 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1677 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:18.012942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0fda1e9f-06e1-498f-8996-03625e38de1e tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:18.013974 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-0fda1e9f-06e1-498f-8996-03625e38de1e tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:18.019767 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:18.058956 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0fda1e9f-06e1-498f-8996-03625e38de1e tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:18.058956 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0fda1e9f-06e1-498f-8996-03625e38de1e tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:18.058956 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0fda1e9f-06e1-498f-8996-03625e38de1e tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:18.058956 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0fda1e9f-06e1-498f-8996-03625e38de1e tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:18.135447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-45b7e01d-3a67-4c74-9a27-71e9380798f0 req-836b5809-9464-4351-9cc5-b4fd758bb301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15d8e0d8-eb2a-465d-893a-8e60eb8222ec", "tag": "d8288d41-d69a-403f-8513-8c7e6ea2347c"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:18.155508 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-45b7e01d-3a67-4c74-9a27-71e9380798f0 req-836b5809-9464-4351-9cc5-b4fd758bb301 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:18.155508 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-45b7e01d-3a67-4c74-9a27-71e9380798f0 req-836b5809-9464-4351-9cc5-b4fd758bb301 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:18.190333 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-45b7e01d-3a67-4c74-9a27-71e9380798f0 req-836b5809-9464-4351-9cc5-b4fd758bb301 service nova] Creating event network-changed:d8288d41-d69a-403f-8513-8c7e6ea2347c for instance 15d8e0d8-eb2a-465d-893a-8e60eb8222ec on hv-cinder-79987 Jul 14 14:34:18.202712 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-45b7e01d-3a67-4c74-9a27-71e9380798f0 req-836b5809-9464-4351-9cc5-b4fd758bb301 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091354 Jul 14 14:34:18.207426 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 169/348] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:34:18.300638 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-0fda1e9f-06e1-498f-8996-03625e38de1e tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:18.308915 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-0fda1e9f-06e1-498f-8996-03625e38de1e tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1314 microversion: 2.1 time: 0.299927 Jul 14 14:34:18.318345 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 180/349] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:18 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:18.961595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-90912205-a27c-46b8-8efa-47e8a7840f76 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:18.962304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-90912205-a27c-46b8-8efa-47e8a7840f76 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:18.968910 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-90912205-a27c-46b8-8efa-47e8a7840f76 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:18.969440 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-90912205-a27c-46b8-8efa-47e8a7840f76 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:18.970445 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-90912205-a27c-46b8-8efa-47e8a7840f76 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:18.971151 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-90912205-a27c-46b8-8efa-47e8a7840f76 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:19.155836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-90912205-a27c-46b8-8efa-47e8a7840f76 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:19.164528 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-90912205-a27c-46b8-8efa-47e8a7840f76 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1677 microversion: 2.1 time: 0.207685 Jul 14 14:34:19.165376 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 170/350] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:18 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1677 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:19.326333 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-50d281cc-cded-4061-a13a-1cd3a9c07bd3 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:19.326957 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-50d281cc-cded-4061-a13a-1cd3a9c07bd3 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:19.328794 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=10 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:19.334038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-50d281cc-cded-4061-a13a-1cd3a9c07bd3 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:19.334513 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-50d281cc-cded-4061-a13a-1cd3a9c07bd3 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:19.335266 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-50d281cc-cded-4061-a13a-1cd3a9c07bd3 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:19.335694 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-50d281cc-cded-4061-a13a-1cd3a9c07bd3 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:19.468896 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-50d281cc-cded-4061-a13a-1cd3a9c07bd3 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:19.476556 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-50d281cc-cded-4061-a13a-1cd3a9c07bd3 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1314 microversion: 2.1 time: 0.154215 Jul 14 14:34:19.477105 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 181/351] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:19 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:19.889062 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ead044b4-760c-4ab3-94d5-17c02a224d53 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Action: 'create', calling method: .version_select at 0x7f416c6f3040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-601209965", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2jM+SIiM34cT2rAitwSaf1UGdpPAExqnHG0I6Jy0wUq2uV1o8UGPg0h0mI8hLknV348GCQHfJju0l2DGKvH7OLoorAQCJHSMnmlGGW6uOE9l0NBzHPLaDUcOh3wU4EjA=="}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:19.902923 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-ead044b4-760c-4ab3-94d5-17c02a224d53 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Getting quotas for project 8ae0529df8aa4640806b4e7f3680e87b. Resources: {'key_pairs'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:34:19.906725 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-ead044b4-760c-4ab3-94d5-17c02a224d53 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Getting quotas for user 73045af76072450a999de6d3fc5962e6 and project 8ae0529df8aa4640806b4e7f3680e87b. Resources: {'key_pairs'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:34:20.043741 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ead044b4-760c-4ab3-94d5-17c02a224d53 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.158425 Jul 14 14:34:20.044455 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 171/352] 10.222.0.93 () {60 vars in 1158 bytes} [Thu Jul 14 14:34:19 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:20.094172 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-9861aca4-b834-4ad1-a6eb-a37a78451bda tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1295700613", "imageRef": "f29e9b07-6b87-4457-88a6-b8c3db0f5d98", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-601209965", "networks": [{"uuid": "274f18aa-55c6-4caa-a6c2-103a313ebc1e"}]}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:20.143243 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.network.neutron [None req-9861aca4-b834-4ad1-a6eb-a37a78451bda tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] validate_networks() for [('274f18aa-55c6-4caa-a6c2-103a313ebc1e', None, None, None, None, None)] {{(pid=118461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:34:20.182073 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-1a02d136-c095-4b5c-bc63-91bd5123bcf0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:20.182831 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-1a02d136-c095-4b5c-bc63-91bd5123bcf0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:20.189231 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1a02d136-c095-4b5c-bc63-91bd5123bcf0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:20.189797 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1a02d136-c095-4b5c-bc63-91bd5123bcf0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:20.190629 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1a02d136-c095-4b5c-bc63-91bd5123bcf0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:20.191126 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1a02d136-c095-4b5c-bc63-91bd5123bcf0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:20.394237 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-1a02d136-c095-4b5c-bc63-91bd5123bcf0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:20.402512 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-1a02d136-c095-4b5c-bc63-91bd5123bcf0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1677 microversion: 2.1 time: 0.224357 Jul 14 14:34:20.402914 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 172/353] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:20 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1677 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:20.496407 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-acd303f4-6102-40b0-aadf-42bd2ae33d02 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:20.497285 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-acd303f4-6102-40b0-aadf-42bd2ae33d02 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:20.503812 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-acd303f4-6102-40b0-aadf-42bd2ae33d02 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:20.504290 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-acd303f4-6102-40b0-aadf-42bd2ae33d02 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:20.505048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-acd303f4-6102-40b0-aadf-42bd2ae33d02 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:20.505478 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-acd303f4-6102-40b0-aadf-42bd2ae33d02 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:20.638519 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-9861aca4-b834-4ad1-a6eb-a37a78451bda tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Flavor limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:34:20.638999 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-9861aca4-b834-4ad1-a6eb-a37a78451bda tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Image limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:34:20.639538 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-9861aca4-b834-4ad1-a6eb-a37a78451bda tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Flavor pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:34:20.640012 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-9861aca4-b834-4ad1-a6eb-a37a78451bda tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Image pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:34:20.640493 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-9861aca4-b834-4ad1-a6eb-a37a78451bda tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:34:20.650018 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9861aca4-b834-4ad1-a6eb-a37a78451bda tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:20.650608 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9861aca4-b834-4ad1-a6eb-a37a78451bda tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:20.651518 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9861aca4-b834-4ad1-a6eb-a37a78451bda tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:20.651966 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9861aca4-b834-4ad1-a6eb-a37a78451bda tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:20.667828 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-acd303f4-6102-40b0-aadf-42bd2ae33d02 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:20.669483 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-9861aca4-b834-4ad1-a6eb-a37a78451bda tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Getting quotas for project 8ae0529df8aa4640806b4e7f3680e87b. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:34:20.674109 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-9861aca4-b834-4ad1-a6eb-a37a78451bda tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Getting quotas for user 73045af76072450a999de6d3fc5962e6 and project 8ae0529df8aa4640806b4e7f3680e87b. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:34:20.675742 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-acd303f4-6102-40b0-aadf-42bd2ae33d02 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1314 microversion: 2.1 time: 0.186021 Jul 14 14:34:20.676494 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 173/354] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:20 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:20.687588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-9861aca4-b834-4ad1-a6eb-a37a78451bda tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Going to run 1 instances... {{(pid=118461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:34:20.690169 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-9861aca4-b834-4ad1-a6eb-a37a78451bda tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f29e9b07-6b87-4457-88a6-b8c3db0f5d98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:34:20.828085 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-9861aca4-b834-4ad1-a6eb-a37a78451bda tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738330 Jul 14 14:34:20.828721 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 182/355] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:34:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:34:20.838553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-8a80fa2f-9190-44d1-8a2a-e03481cff569 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:20.839151 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-8a80fa2f-9190-44d1-8a2a-e03481cff569 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:20.891088 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-8a80fa2f-9190-44d1-8a2a-e03481cff569 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:20.897823 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-8a80fa2f-9190-44d1-8a2a-e03481cff569 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1258 microversion: 2.1 time: 0.062995 Jul 14 14:34:20.898390 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 174/356] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:20 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1258 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:21.421288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-1ff81914-fa46-4900-b821-611936f12f2c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:21.421942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-1ff81914-fa46-4900-b821-611936f12f2c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:21.429380 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1ff81914-fa46-4900-b821-611936f12f2c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:21.429863 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1ff81914-fa46-4900-b821-611936f12f2c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:21.430623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1ff81914-fa46-4900-b821-611936f12f2c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:21.431057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1ff81914-fa46-4900-b821-611936f12f2c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:21.566177 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-1ff81914-fa46-4900-b821-611936f12f2c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:21.574227 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-1ff81914-fa46-4900-b821-611936f12f2c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1677 microversion: 2.1 time: 0.157408 Jul 14 14:34:21.575086 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 183/357] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:21 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:21.692466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-673d58e2-bf98-43ec-87ab-dad87d9e6a0c tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:21.693073 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-673d58e2-bf98-43ec-87ab-dad87d9e6a0c tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:21.699483 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-673d58e2-bf98-43ec-87ab-dad87d9e6a0c tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:21.699925 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-673d58e2-bf98-43ec-87ab-dad87d9e6a0c tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:21.700933 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-673d58e2-bf98-43ec-87ab-dad87d9e6a0c tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:21.701307 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-673d58e2-bf98-43ec-87ab-dad87d9e6a0c tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:21.840702 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-673d58e2-bf98-43ec-87ab-dad87d9e6a0c tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:21.848219 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-673d58e2-bf98-43ec-87ab-dad87d9e6a0c tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1314 microversion: 2.1 time: 0.159678 Jul 14 14:34:21.848774 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 175/358] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:21 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:21.914857 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-39977a05-8ed2-46d0-ba9d-453fb5cd1606 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:21.915528 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-39977a05-8ed2-46d0-ba9d-453fb5cd1606 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:21.968029 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-39977a05-8ed2-46d0-ba9d-453fb5cd1606 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:21.974941 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-39977a05-8ed2-46d0-ba9d-453fb5cd1606 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1258 microversion: 2.1 time: 0.064427 Jul 14 14:34:21.981541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 184/359] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:21 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:22.591833 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c971e7e3-b4fa-4e1e-ba6f-c7b288bebf47 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:22.592401 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c971e7e3-b4fa-4e1e-ba6f-c7b288bebf47 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:22.598560 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c971e7e3-b4fa-4e1e-ba6f-c7b288bebf47 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:22.599007 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c971e7e3-b4fa-4e1e-ba6f-c7b288bebf47 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:22.599765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c971e7e3-b4fa-4e1e-ba6f-c7b288bebf47 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:22.600254 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c971e7e3-b4fa-4e1e-ba6f-c7b288bebf47 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:22.732151 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-c971e7e3-b4fa-4e1e-ba6f-c7b288bebf47 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:22.739844 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c971e7e3-b4fa-4e1e-ba6f-c7b288bebf47 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1677 microversion: 2.1 time: 0.151931 Jul 14 14:34:22.740423 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 176/360] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:22 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:22.867617 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-5b1134a9-cd94-4e9e-9b31-112ba7e4608b tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:22.868335 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-5b1134a9-cd94-4e9e-9b31-112ba7e4608b tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:22.875603 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5b1134a9-cd94-4e9e-9b31-112ba7e4608b tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:22.876025 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5b1134a9-cd94-4e9e-9b31-112ba7e4608b tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:22.876776 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5b1134a9-cd94-4e9e-9b31-112ba7e4608b tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:22.877206 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5b1134a9-cd94-4e9e-9b31-112ba7e4608b tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:22.997213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-edbda506-cada-4277-8dca-9b8142210af4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:22.998245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-edbda506-cada-4277-8dca-9b8142210af4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:23.004806 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-edbda506-cada-4277-8dca-9b8142210af4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:23.005258 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-edbda506-cada-4277-8dca-9b8142210af4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:23.006055 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-edbda506-cada-4277-8dca-9b8142210af4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:23.006486 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-edbda506-cada-4277-8dca-9b8142210af4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:23.008504 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5b1134a9-cd94-4e9e-9b31-112ba7e4608b tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:23.022743 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-5b1134a9-cd94-4e9e-9b31-112ba7e4608b tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1314 microversion: 2.1 time: 0.159782 Jul 14 14:34:23.024070 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 185/361] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:22 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:23.025300 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:23.069617 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-edbda506-cada-4277-8dca-9b8142210af4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:23.077368 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-edbda506-cada-4277-8dca-9b8142210af4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1254 microversion: 2.1 time: 0.084173 Jul 14 14:34:23.087154 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 177/362] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:22 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1254 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:23.407613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-36e298ab-9baf-439f-a7cb-a757f470e5f1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:23.408761 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-36e298ab-9baf-439f-a7cb-a757f470e5f1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:23.415641 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-36e298ab-9baf-439f-a7cb-a757f470e5f1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:23.419060 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-36e298ab-9baf-439f-a7cb-a757f470e5f1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:23.419060 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-36e298ab-9baf-439f-a7cb-a757f470e5f1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:23.419060 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-36e298ab-9baf-439f-a7cb-a757f470e5f1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:23.440840 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.objects.instance [None req-36e298ab-9baf-439f-a7cb-a757f470e5f1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lazy-loading 'flavor' on Instance uuid d79f9504-35ca-452e-8c51-8db181ea74a7 {{(pid=118461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:34:23.757466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e6003ac3-8ee4-4dc9-a30b-fc2687cc0621 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:23.758208 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e6003ac3-8ee4-4dc9-a30b-fc2687cc0621 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:23.765495 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e6003ac3-8ee4-4dc9-a30b-fc2687cc0621 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:23.766068 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e6003ac3-8ee4-4dc9-a30b-fc2687cc0621 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:23.766826 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e6003ac3-8ee4-4dc9-a30b-fc2687cc0621 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:23.767273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e6003ac3-8ee4-4dc9-a30b-fc2687cc0621 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:23.895660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-36e298ab-9baf-439f-a7cb-a757f470e5f1 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "POST /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/action" status: 200 len: 32 microversion: 2.1 time: 0.492476 Jul 14 14:34:23.898957 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 186/363] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 14 14:34:23 2022] POST /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/action => generated 32 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:34:23.906635 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-66c1f7a3-8cc9-4a7b-8582-e8e02f9aeeec tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:23.907330 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-66c1f7a3-8cc9-4a7b-8582-e8e02f9aeeec tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:23.914378 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-66c1f7a3-8cc9-4a7b-8582-e8e02f9aeeec tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:23.915137 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-66c1f7a3-8cc9-4a7b-8582-e8e02f9aeeec tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:23.915907 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-66c1f7a3-8cc9-4a7b-8582-e8e02f9aeeec tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:23.916328 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-66c1f7a3-8cc9-4a7b-8582-e8e02f9aeeec tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:23.920463 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e6003ac3-8ee4-4dc9-a30b-fc2687cc0621 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:23.928417 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e6003ac3-8ee4-4dc9-a30b-fc2687cc0621 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1677 microversion: 2.1 time: 0.175218 Jul 14 14:34:23.929093 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 178/364] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:23 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:24.047873 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-289523af-d5ee-40fb-9e0a-f514792eecab tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:24.048453 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-289523af-d5ee-40fb-9e0a-f514792eecab tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:24.055849 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-289523af-d5ee-40fb-9e0a-f514792eecab tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:24.056871 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-66c1f7a3-8cc9-4a7b-8582-e8e02f9aeeec tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:24.074493 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-289523af-d5ee-40fb-9e0a-f514792eecab tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:24.074493 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-289523af-d5ee-40fb-9e0a-f514792eecab tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:24.074493 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-289523af-d5ee-40fb-9e0a-f514792eecab tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:24.074831 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-66c1f7a3-8cc9-4a7b-8582-e8e02f9aeeec tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.164990 Jul 14 14:34:24.074831 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 187/365] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:23 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:24.106150 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ab2eadd1-32e0-4a00-953a-b5ac8c2ff94e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:24.106766 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-ab2eadd1-32e0-4a00-953a-b5ac8c2ff94e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:24.112941 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ab2eadd1-32e0-4a00-953a-b5ac8c2ff94e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:24.113396 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ab2eadd1-32e0-4a00-953a-b5ac8c2ff94e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:24.114249 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ab2eadd1-32e0-4a00-953a-b5ac8c2ff94e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:24.114687 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ab2eadd1-32e0-4a00-953a-b5ac8c2ff94e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:24.119858 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:24.204671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-ab2eadd1-32e0-4a00-953a-b5ac8c2ff94e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:24.216106 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-ab2eadd1-32e0-4a00-953a-b5ac8c2ff94e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1318 microversion: 2.1 time: 0.114810 Jul 14 14:34:24.217053 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 188/366] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:24 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1318 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:24.245299 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-289523af-d5ee-40fb-9e0a-f514792eecab tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:24.253116 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-289523af-d5ee-40fb-9e0a-f514792eecab tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1314 microversion: 2.1 time: 0.209304 Jul 14 14:34:24.253692 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 179/367] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:24 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:24.947793 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0e75724c-a76d-4686-bcea-8c2e968ece3e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:24.948800 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-0e75724c-a76d-4686-bcea-8c2e968ece3e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:24.966967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0e75724c-a76d-4686-bcea-8c2e968ece3e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:24.967682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0e75724c-a76d-4686-bcea-8c2e968ece3e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:24.968632 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0e75724c-a76d-4686-bcea-8c2e968ece3e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:24.969227 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0e75724c-a76d-4686-bcea-8c2e968ece3e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:25.088795 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-57e39b19-cb09-4a98-af33-0079dbb03d9b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:25.089481 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-57e39b19-cb09-4a98-af33-0079dbb03d9b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:25.114724 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-57e39b19-cb09-4a98-af33-0079dbb03d9b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:25.115423 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-57e39b19-cb09-4a98-af33-0079dbb03d9b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:25.116462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-57e39b19-cb09-4a98-af33-0079dbb03d9b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:25.118152 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-57e39b19-cb09-4a98-af33-0079dbb03d9b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:25.240666 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-0e75724c-a76d-4686-bcea-8c2e968ece3e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:25.254819 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-0e75724c-a76d-4686-bcea-8c2e968ece3e tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1677 microversion: 2.1 time: 0.310006 Jul 14 14:34:25.258457 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 189/368] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:24 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1677 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:25.269275 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-7dc1f0c0-c013-4996-befd-2031f953e8c7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:25.273465 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-7dc1f0c0-c013-4996-befd-2031f953e8c7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:25.285677 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7dc1f0c0-c013-4996-befd-2031f953e8c7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:25.289723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7dc1f0c0-c013-4996-befd-2031f953e8c7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:25.290755 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7dc1f0c0-c013-4996-befd-2031f953e8c7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:25.291274 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7dc1f0c0-c013-4996-befd-2031f953e8c7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:25.425122 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-57e39b19-cb09-4a98-af33-0079dbb03d9b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:25.439949 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-57e39b19-cb09-4a98-af33-0079dbb03d9b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.356669 Jul 14 14:34:25.442075 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 180/369] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:25 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:25.447644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ae16b25b-1374-42b9-bd3b-3a381acc76d6 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:25.448687 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ae16b25b-1374-42b9-bd3b-3a381acc76d6 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:25.455294 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ae16b25b-1374-42b9-bd3b-3a381acc76d6 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:25.456052 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ae16b25b-1374-42b9-bd3b-3a381acc76d6 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:25.457136 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ae16b25b-1374-42b9-bd3b-3a381acc76d6 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:25.457719 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ae16b25b-1374-42b9-bd3b-3a381acc76d6 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:25.646033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7dc1f0c0-c013-4996-befd-2031f953e8c7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:25.655473 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-7dc1f0c0-c013-4996-befd-2031f953e8c7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.395388 Jul 14 14:34:25.656969 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 190/370] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:25 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:25.665100 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-1eec1207-8406-452e-93d3-21aebd23fa2e req-5cfbd23c-f98f-4094-bb99-3a9733d705fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d8e0d8-eb2a-465d-893a-8e60eb8222ec", "name": "network-vif-plugged", "status": "completed", "tag": "d8288d41-d69a-403f-8513-8c7e6ea2347c"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:25.682174 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-1eec1207-8406-452e-93d3-21aebd23fa2e req-5cfbd23c-f98f-4094-bb99-3a9733d705fe service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:25.682871 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-1eec1207-8406-452e-93d3-21aebd23fa2e req-5cfbd23c-f98f-4094-bb99-3a9733d705fe service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:25.699831 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-1eec1207-8406-452e-93d3-21aebd23fa2e req-5cfbd23c-f98f-4094-bb99-3a9733d705fe service nova] Creating event network-vif-plugged:d8288d41-d69a-403f-8513-8c7e6ea2347c for instance 15d8e0d8-eb2a-465d-893a-8e60eb8222ec on hv-cinder-79987 Jul 14 14:34:25.705720 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-1eec1207-8406-452e-93d3-21aebd23fa2e req-5cfbd23c-f98f-4094-bb99-3a9733d705fe service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046896 Jul 14 14:34:25.706714 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 191/371] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:25.849511 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ae16b25b-1374-42b9-bd3b-3a381acc76d6 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:25.868776 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ae16b25b-1374-42b9-bd3b-3a381acc76d6 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1314 microversion: 2.1 time: 0.424399 Jul 14 14:34:25.872038 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 181/372] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:25 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:26.277313 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-38625443-c25d-47a1-b155-167a71f5c9e6 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:26.278170 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-38625443-c25d-47a1-b155-167a71f5c9e6 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:26.285639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-38625443-c25d-47a1-b155-167a71f5c9e6 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:26.286141 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-38625443-c25d-47a1-b155-167a71f5c9e6 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:26.286911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-38625443-c25d-47a1-b155-167a71f5c9e6 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:26.287389 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-38625443-c25d-47a1-b155-167a71f5c9e6 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:26.445080 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-38625443-c25d-47a1-b155-167a71f5c9e6 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:26.452826 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-38625443-c25d-47a1-b155-167a71f5c9e6 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1677 microversion: 2.1 time: 0.181701 Jul 14 14:34:26.453622 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 192/373] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:26 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:26.466822 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-bb9aedd7-739d-492d-b03c-f6a8fe93f8aa tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:26.467511 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-bb9aedd7-739d-492d-b03c-f6a8fe93f8aa tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:26.473976 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bb9aedd7-739d-492d-b03c-f6a8fe93f8aa tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:26.475354 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bb9aedd7-739d-492d-b03c-f6a8fe93f8aa tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:26.476010 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bb9aedd7-739d-492d-b03c-f6a8fe93f8aa tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:26.476461 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bb9aedd7-739d-492d-b03c-f6a8fe93f8aa tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:26.508387 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-a9ad9284-0319-479e-b371-a4a5d4c72aee req-40ef1d2b-f7b2-4edf-a58a-8a1ddf3181f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19ce733-1092-4a21-9c56-5f3b570afb2d", "tag": "952e7af0-ae31-4c8d-891e-163bc4da7b6e"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:26.522762 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-a9ad9284-0319-479e-b371-a4a5d4c72aee req-40ef1d2b-f7b2-4edf-a58a-8a1ddf3181f9 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:26.523477 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-a9ad9284-0319-479e-b371-a4a5d4c72aee req-40ef1d2b-f7b2-4edf-a58a-8a1ddf3181f9 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:26.536031 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-a9ad9284-0319-479e-b371-a4a5d4c72aee req-40ef1d2b-f7b2-4edf-a58a-8a1ddf3181f9 service nova] Creating event network-changed:952e7af0-ae31-4c8d-891e-163bc4da7b6e for instance e19ce733-1092-4a21-9c56-5f3b570afb2d on hv-cinder-79987 Jul 14 14:34:26.542267 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-a9ad9284-0319-479e-b371-a4a5d4c72aee req-40ef1d2b-f7b2-4edf-a58a-8a1ddf3181f9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047358 Jul 14 14:34:26.543546 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 193/374] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:26.670985 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-bb9aedd7-739d-492d-b03c-f6a8fe93f8aa tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:26.674742 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-88802154-4e09-4613-b5dd-fcb672f78c9d tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:26.675823 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-88802154-4e09-4613-b5dd-fcb672f78c9d tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:26.682954 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-88802154-4e09-4613-b5dd-fcb672f78c9d tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:26.683400 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-88802154-4e09-4613-b5dd-fcb672f78c9d tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:26.684160 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-88802154-4e09-4613-b5dd-fcb672f78c9d tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:26.684587 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-88802154-4e09-4613-b5dd-fcb672f78c9d tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:26.685124 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-bb9aedd7-739d-492d-b03c-f6a8fe93f8aa tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.221920 Jul 14 14:34:26.686042 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 182/375] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:26 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:26.836499 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-88802154-4e09-4613-b5dd-fcb672f78c9d tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:26.845508 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-88802154-4e09-4613-b5dd-fcb672f78c9d tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.175310 Jul 14 14:34:26.846795 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 194/376] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:26 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:26.889620 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-2ff94b2d-9453-43d3-a366-29248d44bdce tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:26.890256 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-2ff94b2d-9453-43d3-a366-29248d44bdce tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:26.897644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2ff94b2d-9453-43d3-a366-29248d44bdce tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:26.898288 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2ff94b2d-9453-43d3-a366-29248d44bdce tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:26.899786 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2ff94b2d-9453-43d3-a366-29248d44bdce tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:26.900436 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2ff94b2d-9453-43d3-a366-29248d44bdce tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:27.040292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-2ff94b2d-9453-43d3-a366-29248d44bdce tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:27.048112 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-2ff94b2d-9453-43d3-a366-29248d44bdce tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1314 microversion: 2.1 time: 0.162187 Jul 14 14:34:27.049048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 183/377] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:26 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:27.470453 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-6db5156b-2efe-4cea-8baf-abb9d6fa4d97 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:27.471108 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-6db5156b-2efe-4cea-8baf-abb9d6fa4d97 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:27.477732 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6db5156b-2efe-4cea-8baf-abb9d6fa4d97 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:27.478274 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6db5156b-2efe-4cea-8baf-abb9d6fa4d97 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:27.479065 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6db5156b-2efe-4cea-8baf-abb9d6fa4d97 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:27.479455 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6db5156b-2efe-4cea-8baf-abb9d6fa4d97 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:27.637760 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-6db5156b-2efe-4cea-8baf-abb9d6fa4d97 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:27.647342 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-6db5156b-2efe-4cea-8baf-abb9d6fa4d97 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1677 microversion: 2.1 time: 0.180775 Jul 14 14:34:27.648138 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 195/378] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:27 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:27.703148 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0dd02972-aa50-48ec-bfc1-91b197ecf911 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:27.703789 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0dd02972-aa50-48ec-bfc1-91b197ecf911 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:27.710124 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0dd02972-aa50-48ec-bfc1-91b197ecf911 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:27.710621 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0dd02972-aa50-48ec-bfc1-91b197ecf911 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:27.711411 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0dd02972-aa50-48ec-bfc1-91b197ecf911 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:27.711847 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0dd02972-aa50-48ec-bfc1-91b197ecf911 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:27.860351 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-0dd02972-aa50-48ec-bfc1-91b197ecf911 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:27.862040 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-12a2fa24-62ac-481a-afb3-6109384033c3 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:27.862714 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-12a2fa24-62ac-481a-afb3-6109384033c3 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:27.869388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-12a2fa24-62ac-481a-afb3-6109384033c3 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:27.869558 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0dd02972-aa50-48ec-bfc1-91b197ecf911 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.170189 Jul 14 14:34:27.870113 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 184/379] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:27 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:27.870270 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-12a2fa24-62ac-481a-afb3-6109384033c3 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:27.878208 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-12a2fa24-62ac-481a-afb3-6109384033c3 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:27.878831 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-12a2fa24-62ac-481a-afb3-6109384033c3 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:28.038987 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-12a2fa24-62ac-481a-afb3-6109384033c3 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:28.046934 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-12a2fa24-62ac-481a-afb3-6109384033c3 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.188744 Jul 14 14:34:28.051502 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 196/380] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:27 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:28.067028 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-96e7a043-540f-44ab-b1ae-67059a6aa9a2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:28.067729 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-96e7a043-540f-44ab-b1ae-67059a6aa9a2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:28.074723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-96e7a043-540f-44ab-b1ae-67059a6aa9a2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:28.075167 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-96e7a043-540f-44ab-b1ae-67059a6aa9a2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:28.075927 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-96e7a043-540f-44ab-b1ae-67059a6aa9a2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:28.076350 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-96e7a043-540f-44ab-b1ae-67059a6aa9a2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:28.218842 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-96e7a043-540f-44ab-b1ae-67059a6aa9a2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:28.228257 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-96e7a043-540f-44ab-b1ae-67059a6aa9a2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1314 microversion: 2.1 time: 0.165026 Jul 14 14:34:28.228955 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 185/381] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:28 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:28.665643 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-55487758-b01e-4824-999b-a0feb6fe70d2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:28.666281 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-55487758-b01e-4824-999b-a0feb6fe70d2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:28.672829 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-55487758-b01e-4824-999b-a0feb6fe70d2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:28.673270 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-55487758-b01e-4824-999b-a0feb6fe70d2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:28.674052 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-55487758-b01e-4824-999b-a0feb6fe70d2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:28.674470 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-55487758-b01e-4824-999b-a0feb6fe70d2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:28.814963 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-55487758-b01e-4824-999b-a0feb6fe70d2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:28.823248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-55487758-b01e-4824-999b-a0feb6fe70d2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1677 microversion: 2.1 time: 0.162138 Jul 14 14:34:28.823814 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 197/382] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:28 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:28.888809 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-fd0bdc3f-a612-4034-a4be-d4414e24fdcb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:28.889432 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-fd0bdc3f-a612-4034-a4be-d4414e24fdcb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:28.895500 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fd0bdc3f-a612-4034-a4be-d4414e24fdcb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:28.895950 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fd0bdc3f-a612-4034-a4be-d4414e24fdcb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:28.896740 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fd0bdc3f-a612-4034-a4be-d4414e24fdcb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:28.897695 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fd0bdc3f-a612-4034-a4be-d4414e24fdcb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:29.060932 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-fd0bdc3f-a612-4034-a4be-d4414e24fdcb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:29.070639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-df89fc4d-2a9b-4e65-81fa-aafde091644e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:29.071256 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-df89fc4d-2a9b-4e65-81fa-aafde091644e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:29.071384 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-fd0bdc3f-a612-4034-a4be-d4414e24fdcb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.186222 Jul 14 14:34:29.072331 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 186/383] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:28 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:29.082635 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-df89fc4d-2a9b-4e65-81fa-aafde091644e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:29.082635 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-df89fc4d-2a9b-4e65-81fa-aafde091644e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:29.082635 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-df89fc4d-2a9b-4e65-81fa-aafde091644e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:29.082635 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-df89fc4d-2a9b-4e65-81fa-aafde091644e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:29.219908 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-df89fc4d-2a9b-4e65-81fa-aafde091644e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:29.228391 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-df89fc4d-2a9b-4e65-81fa-aafde091644e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.165639 Jul 14 14:34:29.236262 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 198/384] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:29 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:29.245264 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c4771352-d146-481a-b5bb-9be19f3ee987 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:29.246055 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c4771352-d146-481a-b5bb-9be19f3ee987 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:29.252044 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c4771352-d146-481a-b5bb-9be19f3ee987 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:29.252485 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c4771352-d146-481a-b5bb-9be19f3ee987 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:29.253272 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c4771352-d146-481a-b5bb-9be19f3ee987 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:29.253702 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c4771352-d146-481a-b5bb-9be19f3ee987 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:29.394545 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-c4771352-d146-481a-b5bb-9be19f3ee987 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:29.404165 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c4771352-d146-481a-b5bb-9be19f3ee987 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1314 microversion: 2.1 time: 0.162529 Jul 14 14:34:29.404819 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 187/385] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:29 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:29.840803 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e07265a2-5f15-4c01-bbb8-b6d47d2fed59 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:29.841497 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e07265a2-5f15-4c01-bbb8-b6d47d2fed59 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:29.847974 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e07265a2-5f15-4c01-bbb8-b6d47d2fed59 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:29.848411 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e07265a2-5f15-4c01-bbb8-b6d47d2fed59 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:29.849158 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e07265a2-5f15-4c01-bbb8-b6d47d2fed59 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:29.849583 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e07265a2-5f15-4c01-bbb8-b6d47d2fed59 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:29.989130 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e07265a2-5f15-4c01-bbb8-b6d47d2fed59 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:29.998293 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e07265a2-5f15-4c01-bbb8-b6d47d2fed59 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1677 microversion: 2.1 time: 0.161443 Jul 14 14:34:29.998876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 199/386] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:29 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:30.089102 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-031ebb75-a288-4fd8-b4d5-acd626f1f6d9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:30.089710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-031ebb75-a288-4fd8-b4d5-acd626f1f6d9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:30.095715 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-031ebb75-a288-4fd8-b4d5-acd626f1f6d9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:30.096162 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-031ebb75-a288-4fd8-b4d5-acd626f1f6d9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:30.096926 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-031ebb75-a288-4fd8-b4d5-acd626f1f6d9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:30.097358 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-031ebb75-a288-4fd8-b4d5-acd626f1f6d9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:30.243426 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-031ebb75-a288-4fd8-b4d5-acd626f1f6d9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:30.247414 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d31f7b82-fc00-4282-ad62-3bcb89ea5a62 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:30.248196 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d31f7b82-fc00-4282-ad62-3bcb89ea5a62 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:30.252599 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-031ebb75-a288-4fd8-b4d5-acd626f1f6d9 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.167301 Jul 14 14:34:30.253269 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 188/387] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:30 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:30.256951 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d31f7b82-fc00-4282-ad62-3bcb89ea5a62 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:30.257402 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d31f7b82-fc00-4282-ad62-3bcb89ea5a62 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:30.258241 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d31f7b82-fc00-4282-ad62-3bcb89ea5a62 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:30.258674 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d31f7b82-fc00-4282-ad62-3bcb89ea5a62 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:30.408833 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d31f7b82-fc00-4282-ad62-3bcb89ea5a62 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:30.416929 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d31f7b82-fc00-4282-ad62-3bcb89ea5a62 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.174000 Jul 14 14:34:30.417679 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 200/388] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:30 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:30.424446 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-9534f19f-a5ce-46e8-acaf-f93d27e8e0a8 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:30.425057 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-9534f19f-a5ce-46e8-acaf-f93d27e8e0a8 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:30.431685 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9534f19f-a5ce-46e8-acaf-f93d27e8e0a8 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:30.432131 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9534f19f-a5ce-46e8-acaf-f93d27e8e0a8 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:30.432891 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9534f19f-a5ce-46e8-acaf-f93d27e8e0a8 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:30.433429 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9534f19f-a5ce-46e8-acaf-f93d27e8e0a8 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:30.574975 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-9534f19f-a5ce-46e8-acaf-f93d27e8e0a8 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:30.582894 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-9534f19f-a5ce-46e8-acaf-f93d27e8e0a8 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1314 microversion: 2.1 time: 0.162275 Jul 14 14:34:30.584053 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 189/389] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:30 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:31.015975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b617018b-b3d1-40a6-b7f2-64e8beddb760 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:31.016581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b617018b-b3d1-40a6-b7f2-64e8beddb760 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:31.018606 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:31.024398 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b617018b-b3d1-40a6-b7f2-64e8beddb760 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.024839 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b617018b-b3d1-40a6-b7f2-64e8beddb760 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.025722 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b617018b-b3d1-40a6-b7f2-64e8beddb760 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.032146 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b617018b-b3d1-40a6-b7f2-64e8beddb760 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.172318 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b617018b-b3d1-40a6-b7f2-64e8beddb760 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:31.180047 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b617018b-b3d1-40a6-b7f2-64e8beddb760 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1677 microversion: 2.1 time: 0.167976 Jul 14 14:34:31.180837 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 201/390] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:31 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:31.270451 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-056a5ce5-5279-4a77-bc22-dcabab4f535a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:31.271076 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-056a5ce5-5279-4a77-bc22-dcabab4f535a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:31.273679 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=6 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:31.278518 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-056a5ce5-5279-4a77-bc22-dcabab4f535a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.279009 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-056a5ce5-5279-4a77-bc22-dcabab4f535a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.279868 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-056a5ce5-5279-4a77-bc22-dcabab4f535a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.280314 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-056a5ce5-5279-4a77-bc22-dcabab4f535a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.419723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-056a5ce5-5279-4a77-bc22-dcabab4f535a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:31.428566 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-056a5ce5-5279-4a77-bc22-dcabab4f535a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.161901 Jul 14 14:34:31.429321 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 190/391] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:31 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:31.434003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-8d18ca84-6e8a-4bb9-9f9e-36cb3b8c27d6 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:31.434608 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-8d18ca84-6e8a-4bb9-9f9e-36cb3b8c27d6 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:31.440700 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8d18ca84-6e8a-4bb9-9f9e-36cb3b8c27d6 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.441142 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8d18ca84-6e8a-4bb9-9f9e-36cb3b8c27d6 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.442029 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8d18ca84-6e8a-4bb9-9f9e-36cb3b8c27d6 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.442362 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8d18ca84-6e8a-4bb9-9f9e-36cb3b8c27d6 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.582909 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-8d18ca84-6e8a-4bb9-9f9e-36cb3b8c27d6 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:31.591677 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-8d18ca84-6e8a-4bb9-9f9e-36cb3b8c27d6 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.161086 Jul 14 14:34:31.593454 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 202/392] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:31 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:31.608808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-79356a30-705c-41cf-82e8-cc9fb9d6e708 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:31.609478 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-79356a30-705c-41cf-82e8-cc9fb9d6e708 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:31.617559 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-79356a30-705c-41cf-82e8-cc9fb9d6e708 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.618041 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-79356a30-705c-41cf-82e8-cc9fb9d6e708 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.618803 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-79356a30-705c-41cf-82e8-cc9fb9d6e708 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:31.619227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-79356a30-705c-41cf-82e8-cc9fb9d6e708 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:31.782171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-79356a30-705c-41cf-82e8-cc9fb9d6e708 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:31.790435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-79356a30-705c-41cf-82e8-cc9fb9d6e708 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1314 microversion: 2.1 time: 0.189568 Jul 14 14:34:31.791020 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 191/393] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:31 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:32.196601 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-59d8621e-33f2-4d1d-91ac-f51d8bd2c23c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:32.197800 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-59d8621e-33f2-4d1d-91ac-f51d8bd2c23c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:32.199254 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=8 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:32.204966 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:32.207101 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-59d8621e-33f2-4d1d-91ac-f51d8bd2c23c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:32.207549 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-59d8621e-33f2-4d1d-91ac-f51d8bd2c23c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:32.208444 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-59d8621e-33f2-4d1d-91ac-f51d8bd2c23c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:32.208877 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-59d8621e-33f2-4d1d-91ac-f51d8bd2c23c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:32.360044 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-59d8621e-33f2-4d1d-91ac-f51d8bd2c23c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:32.368983 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-59d8621e-33f2-4d1d-91ac-f51d8bd2c23c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1677 microversion: 2.1 time: 0.176067 Jul 14 14:34:32.370421 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 203/394] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:32 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:32.447667 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-eb19983f-2401-43ae-aaef-e987f3fcdc48 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:32.448366 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-eb19983f-2401-43ae-aaef-e987f3fcdc48 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:32.454714 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-eb19983f-2401-43ae-aaef-e987f3fcdc48 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:32.455161 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-eb19983f-2401-43ae-aaef-e987f3fcdc48 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:32.455933 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-eb19983f-2401-43ae-aaef-e987f3fcdc48 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:32.456358 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-eb19983f-2401-43ae-aaef-e987f3fcdc48 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:32.596882 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-eb19983f-2401-43ae-aaef-e987f3fcdc48 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:32.605612 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-eb19983f-2401-43ae-aaef-e987f3fcdc48 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.162105 Jul 14 14:34:32.606424 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 192/395] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:32 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:32.620575 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c0281b25-58e8-46a1-bdc0-52c0d711e387 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:32.620898 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c0281b25-58e8-46a1-bdc0-52c0d711e387 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:32.627108 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c0281b25-58e8-46a1-bdc0-52c0d711e387 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:32.627559 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c0281b25-58e8-46a1-bdc0-52c0d711e387 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:32.628327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c0281b25-58e8-46a1-bdc0-52c0d711e387 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:32.628757 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c0281b25-58e8-46a1-bdc0-52c0d711e387 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:32.797021 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c0281b25-58e8-46a1-bdc0-52c0d711e387 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:32.807064 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c0281b25-58e8-46a1-bdc0-52c0d711e387 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.190658 Jul 14 14:34:32.807618 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 204/396] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:32 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:32.807845 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-67ab675f-b478-4238-9471-e04759135d49 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:32.808489 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-67ab675f-b478-4238-9471-e04759135d49 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:32.814540 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-67ab675f-b478-4238-9471-e04759135d49 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:32.814988 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-67ab675f-b478-4238-9471-e04759135d49 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:32.815745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-67ab675f-b478-4238-9471-e04759135d49 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:32.816179 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-67ab675f-b478-4238-9471-e04759135d49 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:32.963994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-67ab675f-b478-4238-9471-e04759135d49 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:32.971404 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-67ab675f-b478-4238-9471-e04759135d49 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1314 microversion: 2.1 time: 0.168297 Jul 14 14:34:32.972166 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 193/397] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:32 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:33.386896 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ff212989-3a0a-4a06-afd6-18eb03dbe796 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:33.387528 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-ff212989-3a0a-4a06-afd6-18eb03dbe796 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:33.394078 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ff212989-3a0a-4a06-afd6-18eb03dbe796 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:33.394524 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ff212989-3a0a-4a06-afd6-18eb03dbe796 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:33.395273 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ff212989-3a0a-4a06-afd6-18eb03dbe796 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:33.395701 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ff212989-3a0a-4a06-afd6-18eb03dbe796 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:33.530490 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-ff212989-3a0a-4a06-afd6-18eb03dbe796 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:33.538735 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-ff212989-3a0a-4a06-afd6-18eb03dbe796 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1677 microversion: 2.1 time: 0.155914 Jul 14 14:34:33.542628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 205/398] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:33 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:33.622776 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f243ec79-82e4-4d03-8efb-a785ac0c1d04 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:33.623422 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f243ec79-82e4-4d03-8efb-a785ac0c1d04 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:33.629466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f243ec79-82e4-4d03-8efb-a785ac0c1d04 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:33.629948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f243ec79-82e4-4d03-8efb-a785ac0c1d04 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:33.630707 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f243ec79-82e4-4d03-8efb-a785ac0c1d04 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:33.631141 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f243ec79-82e4-4d03-8efb-a785ac0c1d04 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:33.635113 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=100 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:33.771392 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f243ec79-82e4-4d03-8efb-a785ac0c1d04 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:33.779852 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f243ec79-82e4-4d03-8efb-a785ac0c1d04 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.161007 Jul 14 14:34:33.780418 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 194/399] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:33 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:33.823541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-badec373-5773-4bcc-b017-58c3123b972d tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:33.824149 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-badec373-5773-4bcc-b017-58c3123b972d tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:33.830159 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-badec373-5773-4bcc-b017-58c3123b972d tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:33.830635 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-badec373-5773-4bcc-b017-58c3123b972d tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:33.831387 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-badec373-5773-4bcc-b017-58c3123b972d tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:33.831816 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-badec373-5773-4bcc-b017-58c3123b972d tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:33.836257 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=100 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:33.962742 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-badec373-5773-4bcc-b017-58c3123b972d tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:33.970550 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-badec373-5773-4bcc-b017-58c3123b972d tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.150842 Jul 14 14:34:33.971195 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 206/400] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:33 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:33.988274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-bbf526eb-2bd3-4d53-a12c-d9aad036a289 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:33.988891 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-bbf526eb-2bd3-4d53-a12c-d9aad036a289 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:33.994845 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bbf526eb-2bd3-4d53-a12c-d9aad036a289 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:33.995290 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bbf526eb-2bd3-4d53-a12c-d9aad036a289 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:33.996271 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bbf526eb-2bd3-4d53-a12c-d9aad036a289 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:33.996617 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bbf526eb-2bd3-4d53-a12c-d9aad036a289 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:34.125897 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-bbf526eb-2bd3-4d53-a12c-d9aad036a289 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:34.133881 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-bbf526eb-2bd3-4d53-a12c-d9aad036a289 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1314 microversion: 2.1 time: 0.149423 Jul 14 14:34:34.134451 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 195/401] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:33 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:34.555952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a7ac471c-0c5e-47b7-a5e7-ac4bb68ef678 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:34.556523 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a7ac471c-0c5e-47b7-a5e7-ac4bb68ef678 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:34.563005 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a7ac471c-0c5e-47b7-a5e7-ac4bb68ef678 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:34.563437 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a7ac471c-0c5e-47b7-a5e7-ac4bb68ef678 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:34.564206 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a7ac471c-0c5e-47b7-a5e7-ac4bb68ef678 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:34.564627 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a7ac471c-0c5e-47b7-a5e7-ac4bb68ef678 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:34.692890 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a7ac471c-0c5e-47b7-a5e7-ac4bb68ef678 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:34.700876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a7ac471c-0c5e-47b7-a5e7-ac4bb68ef678 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1654 microversion: 2.1 time: 0.148799 Jul 14 14:34:34.701434 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 207/402] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:34 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1654 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:34.717859 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-aa2d4894-bd8c-4d66-934c-3bafac954194 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:34.723944 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-aa2d4894-bd8c-4d66-934c-3bafac954194 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:34.728005 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-aa2d4894-bd8c-4d66-934c-3bafac954194 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:34.747930 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-aa2d4894-bd8c-4d66-934c-3bafac954194 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Going to try to start instance {{(pid=118462) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 14:34:34.796926 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4c59b3e3-3190-4106-8823-6443c976c7a2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:34.797796 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-4c59b3e3-3190-4106-8823-6443c976c7a2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:34.804149 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4c59b3e3-3190-4106-8823-6443c976c7a2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:34.804712 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4c59b3e3-3190-4106-8823-6443c976c7a2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:34.805714 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4c59b3e3-3190-4106-8823-6443c976c7a2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:34.806242 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4c59b3e3-3190-4106-8823-6443c976c7a2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:34.956760 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4c59b3e3-3190-4106-8823-6443c976c7a2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:34.965982 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4c59b3e3-3190-4106-8823-6443c976c7a2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.173002 Jul 14 14:34:34.967897 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 208/403] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:34 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:34.987152 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-cdd9eea5-4d5b-4e05-b638-c22f421f0b2e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:34.991866 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-cdd9eea5-4d5b-4e05-b638-c22f421f0b2e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:34.993788 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cdd9eea5-4d5b-4e05-b638-c22f421f0b2e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:34.994265 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cdd9eea5-4d5b-4e05-b638-c22f421f0b2e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:34.995018 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cdd9eea5-4d5b-4e05-b638-c22f421f0b2e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:34.995507 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cdd9eea5-4d5b-4e05-b638-c22f421f0b2e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:35.121902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-aa2d4894-bd8c-4d66-934c-3bafac954194 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "POST /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0/action" status: 202 len: 0 microversion: 2.1 time: 0.407675 Jul 14 14:34:35.122871 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 196/404] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 14 14:34:34 2022] POST /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:34:35.124842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-cdd9eea5-4d5b-4e05-b638-c22f421f0b2e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:35.131172 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-100f244a-196e-4477-9464-0f8c9484c2d5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:35.131863 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-100f244a-196e-4477-9464-0f8c9484c2d5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:35.132322 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-cdd9eea5-4d5b-4e05-b638-c22f421f0b2e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.148971 Jul 14 14:34:35.133017 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 209/405] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:34 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:35.138280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-100f244a-196e-4477-9464-0f8c9484c2d5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:35.138724 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-100f244a-196e-4477-9464-0f8c9484c2d5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:35.139638 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-100f244a-196e-4477-9464-0f8c9484c2d5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:35.140073 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-100f244a-196e-4477-9464-0f8c9484c2d5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:35.150848 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a388503a-33a7-46cc-b023-7b38d8f8c696 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:35.151544 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a388503a-33a7-46cc-b023-7b38d8f8c696 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:35.158058 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a388503a-33a7-46cc-b023-7b38d8f8c696 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:35.158166 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a388503a-33a7-46cc-b023-7b38d8f8c696 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:35.158881 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a388503a-33a7-46cc-b023-7b38d8f8c696 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:35.159323 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a388503a-33a7-46cc-b023-7b38d8f8c696 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:35.341104 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-100f244a-196e-4477-9464-0f8c9484c2d5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:35.349597 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-100f244a-196e-4477-9464-0f8c9484c2d5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1663 microversion: 2.1 time: 0.222397 Jul 14 14:34:35.350314 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 197/406] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:35 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1663 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:35.356629 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a388503a-33a7-46cc-b023-7b38d8f8c696 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:35.366518 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a388503a-33a7-46cc-b023-7b38d8f8c696 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1314 microversion: 2.1 time: 0.219919 Jul 14 14:34:35.367093 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 210/407] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:35 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:35.984045 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-64b94adf-c1f2-4ea5-aa9b-322ab289fccb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:35.984862 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-64b94adf-c1f2-4ea5-aa9b-322ab289fccb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:35.991628 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-64b94adf-c1f2-4ea5-aa9b-322ab289fccb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:35.992069 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-64b94adf-c1f2-4ea5-aa9b-322ab289fccb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:35.992829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-64b94adf-c1f2-4ea5-aa9b-322ab289fccb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:35.993258 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-64b94adf-c1f2-4ea5-aa9b-322ab289fccb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.138001 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-64b94adf-c1f2-4ea5-aa9b-322ab289fccb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:36.146272 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-64b94adf-c1f2-4ea5-aa9b-322ab289fccb tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.166647 Jul 14 14:34:36.146871 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 198/408] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:35 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:36.148502 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-567532a9-ae68-4b94-92e5-d961b94f98f7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:36.149102 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-567532a9-ae68-4b94-92e5-d961b94f98f7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:36.156081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-567532a9-ae68-4b94-92e5-d961b94f98f7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:36.156501 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-567532a9-ae68-4b94-92e5-d961b94f98f7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.157252 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-567532a9-ae68-4b94-92e5-d961b94f98f7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:36.157673 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-567532a9-ae68-4b94-92e5-d961b94f98f7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.295594 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-567532a9-ae68-4b94-92e5-d961b94f98f7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:36.305367 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-567532a9-ae68-4b94-92e5-d961b94f98f7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.160756 Jul 14 14:34:36.306312 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 211/409] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:36 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:36.368335 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a8c55bd7-3abf-4fca-83b3-ebed3c30e6f5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:36.369069 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a8c55bd7-3abf-4fca-83b3-ebed3c30e6f5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:36.375404 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a8c55bd7-3abf-4fca-83b3-ebed3c30e6f5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:36.375931 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a8c55bd7-3abf-4fca-83b3-ebed3c30e6f5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.376689 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a8c55bd7-3abf-4fca-83b3-ebed3c30e6f5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:36.377811 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a8c55bd7-3abf-4fca-83b3-ebed3c30e6f5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.384083 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-8dab8309-bd8a-4df6-956c-b2d110cee82f tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:36.384694 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-8dab8309-bd8a-4df6-956c-b2d110cee82f tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:36.391669 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8dab8309-bd8a-4df6-956c-b2d110cee82f tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:36.392123 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8dab8309-bd8a-4df6-956c-b2d110cee82f tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.393118 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8dab8309-bd8a-4df6-956c-b2d110cee82f tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:36.393301 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8dab8309-bd8a-4df6-956c-b2d110cee82f tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:36.617274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a8c55bd7-3abf-4fca-83b3-ebed3c30e6f5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:36.619554 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-8dab8309-bd8a-4df6-956c-b2d110cee82f tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:36.626400 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a8c55bd7-3abf-4fca-83b3-ebed3c30e6f5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1663 microversion: 2.1 time: 0.262530 Jul 14 14:34:36.627427 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 199/410] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:36 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1663 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:36.637131 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-8dab8309-bd8a-4df6-956c-b2d110cee82f tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1314 microversion: 2.1 time: 0.257386 Jul 14 14:34:36.637991 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 212/411] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:36 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:37.165052 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-373fc0a4-0ad3-44e8-9e64-76cdff4e04d4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:37.166048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-373fc0a4-0ad3-44e8-9e64-76cdff4e04d4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:37.172178 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-373fc0a4-0ad3-44e8-9e64-76cdff4e04d4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:37.172779 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-373fc0a4-0ad3-44e8-9e64-76cdff4e04d4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:37.173583 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-373fc0a4-0ad3-44e8-9e64-76cdff4e04d4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:37.174127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-373fc0a4-0ad3-44e8-9e64-76cdff4e04d4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:37.312249 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-373fc0a4-0ad3-44e8-9e64-76cdff4e04d4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:37.320976 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-373fc0a4-0ad3-44e8-9e64-76cdff4e04d4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.161150 Jul 14 14:34:37.321544 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 200/412] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:37 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:37.323426 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-3f8328db-c8e1-4107-bd0f-7f3df75cd68b tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:37.324241 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-3f8328db-c8e1-4107-bd0f-7f3df75cd68b tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:37.331065 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3f8328db-c8e1-4107-bd0f-7f3df75cd68b tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:37.331506 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3f8328db-c8e1-4107-bd0f-7f3df75cd68b tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:37.332260 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3f8328db-c8e1-4107-bd0f-7f3df75cd68b tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:37.332690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3f8328db-c8e1-4107-bd0f-7f3df75cd68b tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:37.461518 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3f8328db-c8e1-4107-bd0f-7f3df75cd68b tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:37.469465 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-3f8328db-c8e1-4107-bd0f-7f3df75cd68b tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.150830 Jul 14 14:34:37.470056 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 213/413] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:37 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:37.644183 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-791e4b5d-67c3-4b35-985d-1d78cd56cdd4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:37.644705 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-791e4b5d-67c3-4b35-985d-1d78cd56cdd4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:37.646690 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:37.651567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-791e4b5d-67c3-4b35-985d-1d78cd56cdd4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:37.652016 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-791e4b5d-67c3-4b35-985d-1d78cd56cdd4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:37.652781 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-791e4b5d-67c3-4b35-985d-1d78cd56cdd4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:37.653214 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-791e4b5d-67c3-4b35-985d-1d78cd56cdd4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:37.655424 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-902884cf-9ef2-49d8-a19a-d859ba13993a tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:37.662733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-902884cf-9ef2-49d8-a19a-d859ba13993a tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:37.662733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-902884cf-9ef2-49d8-a19a-d859ba13993a tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:37.662967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-902884cf-9ef2-49d8-a19a-d859ba13993a tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:37.663617 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-902884cf-9ef2-49d8-a19a-d859ba13993a tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:37.664044 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-902884cf-9ef2-49d8-a19a-d859ba13993a tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:37.849623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-791e4b5d-67c3-4b35-985d-1d78cd56cdd4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:37.857426 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-791e4b5d-67c3-4b35-985d-1d78cd56cdd4 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1663 microversion: 2.1 time: 0.217206 Jul 14 14:34:37.858044 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 201/414] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:37 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1663 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:37.863877 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-902884cf-9ef2-49d8-a19a-d859ba13993a tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:37.872017 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-902884cf-9ef2-49d8-a19a-d859ba13993a tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1463 microversion: 2.1 time: 0.221040 Jul 14 14:34:37.872594 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 214/415] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:37 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1463 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:37.914954 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-52ce4ce1-5fd6-4637-9ab3-92cfe0945de2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:37.915456 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-52ce4ce1-5fd6-4637-9ab3-92cfe0945de2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:37.931915 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-52ce4ce1-5fd6-4637-9ab3-92cfe0945de2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:37.932363 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-52ce4ce1-5fd6-4637-9ab3-92cfe0945de2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:37.933171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-52ce4ce1-5fd6-4637-9ab3-92cfe0945de2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:37.933613 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-52ce4ce1-5fd6-4637-9ab3-92cfe0945de2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:37.960174 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-52ce4ce1-5fd6-4637-9ab3-92cfe0945de2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Going to try to terminate instance {{(pid=118462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:34:38.277912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-52ce4ce1-5fd6-4637-9ab3-92cfe0945de2 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "DELETE /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 204 len: 0 microversion: 2.1 time: 0.367122 Jul 14 14:34:38.278600 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 202/416] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:34:37 2022] DELETE /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:34:38.286749 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-54dcd024-68aa-4f8e-bf44-9f40a1897e18 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:38.287349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-54dcd024-68aa-4f8e-bf44-9f40a1897e18 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:38.293470 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-54dcd024-68aa-4f8e-bf44-9f40a1897e18 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:38.293952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-54dcd024-68aa-4f8e-bf44-9f40a1897e18 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:38.294708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-54dcd024-68aa-4f8e-bf44-9f40a1897e18 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:38.295138 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-54dcd024-68aa-4f8e-bf44-9f40a1897e18 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:38.338729 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a0c15bdb-1308-4960-aed2-d4415bc4fc81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:38.339421 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a0c15bdb-1308-4960-aed2-d4415bc4fc81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:38.345502 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a0c15bdb-1308-4960-aed2-d4415bc4fc81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:38.345989 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a0c15bdb-1308-4960-aed2-d4415bc4fc81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:38.346751 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a0c15bdb-1308-4960-aed2-d4415bc4fc81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:38.347179 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a0c15bdb-1308-4960-aed2-d4415bc4fc81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:38.472895 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-54dcd024-68aa-4f8e-bf44-9f40a1897e18 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:38.481036 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-54dcd024-68aa-4f8e-bf44-9f40a1897e18 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1469 microversion: 2.1 time: 0.198069 Jul 14 14:34:38.481898 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 215/417] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:38 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1469 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:38.491117 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-35d512b1-e1e0-4359-adce-a9aaae465059 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:38.491733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-35d512b1-e1e0-4359-adce-a9aaae465059 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:38.497756 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-35d512b1-e1e0-4359-adce-a9aaae465059 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:38.498245 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-35d512b1-e1e0-4359-adce-a9aaae465059 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:38.498982 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-35d512b1-e1e0-4359-adce-a9aaae465059 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:38.499416 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-35d512b1-e1e0-4359-adce-a9aaae465059 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:38.503387 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a0c15bdb-1308-4960-aed2-d4415bc4fc81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:38.511498 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a0c15bdb-1308-4960-aed2-d4415bc4fc81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.176992 Jul 14 14:34:38.512361 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 203/418] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:38 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:38.631487 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-35d512b1-e1e0-4359-adce-a9aaae465059 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:38.638873 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-35d512b1-e1e0-4359-adce-a9aaae465059 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.152132 Jul 14 14:34:38.639442 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 216/419] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:38 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:38.875388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-dd40c06e-14af-4de4-bda3-6a80ed19142d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:38.875992 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-dd40c06e-14af-4de4-bda3-6a80ed19142d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:38.881976 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-dd40c06e-14af-4de4-bda3-6a80ed19142d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:38.882427 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-dd40c06e-14af-4de4-bda3-6a80ed19142d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:38.883176 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-dd40c06e-14af-4de4-bda3-6a80ed19142d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:38.883610 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-dd40c06e-14af-4de4-bda3-6a80ed19142d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:39.011903 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-dd40c06e-14af-4de4-bda3-6a80ed19142d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:39.019361 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-dd40c06e-14af-4de4-bda3-6a80ed19142d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1663 microversion: 2.1 time: 0.147832 Jul 14 14:34:39.019926 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 204/420] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:38 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1663 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:39.499686 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-959ebf9b-da19-473e-b9e1-b0e1a2fc996c tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:39.500282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-959ebf9b-da19-473e-b9e1-b0e1a2fc996c tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:39.506735 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-959ebf9b-da19-473e-b9e1-b0e1a2fc996c tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:39.507331 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-959ebf9b-da19-473e-b9e1-b0e1a2fc996c tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:39.508114 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-959ebf9b-da19-473e-b9e1-b0e1a2fc996c tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:39.508542 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-959ebf9b-da19-473e-b9e1-b0e1a2fc996c tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:39.528978 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-874ff878-c08c-4ddc-b8b9-b8f18644a5df tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:39.539292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-874ff878-c08c-4ddc-b8b9-b8f18644a5df tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:39.539292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-874ff878-c08c-4ddc-b8b9-b8f18644a5df tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:39.539292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-874ff878-c08c-4ddc-b8b9-b8f18644a5df tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:39.539292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-874ff878-c08c-4ddc-b8b9-b8f18644a5df tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:39.539695 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-874ff878-c08c-4ddc-b8b9-b8f18644a5df tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:39.921060 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-959ebf9b-da19-473e-b9e1-b0e1a2fc996c tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:39.925099 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-874ff878-c08c-4ddc-b8b9-b8f18644a5df tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:39.929872 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-959ebf9b-da19-473e-b9e1-b0e1a2fc996c tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1469 microversion: 2.1 time: 0.433912 Jul 14 14:34:39.930447 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 217/421] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:39 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1469 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:39.934278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-874ff878-c08c-4ddc-b8b9-b8f18644a5df tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.408610 Jul 14 14:34:39.935144 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-9a1ef9c5-b6f8-45e4-8074-7f1875c6095b tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:39.935752 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-9a1ef9c5-b6f8-45e4-8074-7f1875c6095b tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:39.938637 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 205/422] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:39 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:39.942007 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9a1ef9c5-b6f8-45e4-8074-7f1875c6095b tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:39.942449 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9a1ef9c5-b6f8-45e4-8074-7f1875c6095b tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:39.943363 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9a1ef9c5-b6f8-45e4-8074-7f1875c6095b tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:39.943802 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9a1ef9c5-b6f8-45e4-8074-7f1875c6095b tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:40.036347 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b1fd3ec3-2c07-4bee-837e-525f9a4ad347 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:40.036946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b1fd3ec3-2c07-4bee-837e-525f9a4ad347 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:40.043123 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b1fd3ec3-2c07-4bee-837e-525f9a4ad347 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:40.043567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b1fd3ec3-2c07-4bee-837e-525f9a4ad347 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:40.044410 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b1fd3ec3-2c07-4bee-837e-525f9a4ad347 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:40.044845 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b1fd3ec3-2c07-4bee-837e-525f9a4ad347 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:40.071504 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-9a1ef9c5-b6f8-45e4-8074-7f1875c6095b tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:40.079491 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-9a1ef9c5-b6f8-45e4-8074-7f1875c6095b tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.147961 Jul 14 14:34:40.080236 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 218/423] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:39 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:40.174603 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b1fd3ec3-2c07-4bee-837e-525f9a4ad347 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:40.181938 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b1fd3ec3-2c07-4bee-837e-525f9a4ad347 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1663 microversion: 2.1 time: 0.149460 Jul 14 14:34:40.182499 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 206/424] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:40 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:40.948201 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-2983a5ad-c80a-465c-9f9e-45a4b5ddcb33 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:40.948773 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-2983a5ad-c80a-465c-9f9e-45a4b5ddcb33 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:40.950619 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d8d3c188-ed35-42ae-a564-b1166a3a8dde tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:40.951251 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-d8d3c188-ed35-42ae-a564-b1166a3a8dde tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:40.956686 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2983a5ad-c80a-465c-9f9e-45a4b5ddcb33 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:40.957122 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2983a5ad-c80a-465c-9f9e-45a4b5ddcb33 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:40.957926 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2983a5ad-c80a-465c-9f9e-45a4b5ddcb33 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:40.958067 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d8d3c188-ed35-42ae-a564-b1166a3a8dde tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:40.958341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2983a5ad-c80a-465c-9f9e-45a4b5ddcb33 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:40.958481 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d8d3c188-ed35-42ae-a564-b1166a3a8dde tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:40.960293 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d8d3c188-ed35-42ae-a564-b1166a3a8dde tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:40.960542 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d8d3c188-ed35-42ae-a564-b1166a3a8dde tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:41.156962 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-2983a5ad-c80a-465c-9f9e-45a4b5ddcb33 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:41.160163 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-d8d3c188-ed35-42ae-a564-b1166a3a8dde tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:41.164712 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-2983a5ad-c80a-465c-9f9e-45a4b5ddcb33 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1469 microversion: 2.1 time: 0.220457 Jul 14 14:34:41.165282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 219/425] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:40 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1469 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:41.169871 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-40052461-8ebe-4b0c-b398-3a08c78476cd tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:41.170490 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-40052461-8ebe-4b0c-b398-3a08c78476cd tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:41.173591 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-d8d3c188-ed35-42ae-a564-b1166a3a8dde tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.226784 Jul 14 14:34:41.174225 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 207/426] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:40 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:41.176290 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-40052461-8ebe-4b0c-b398-3a08c78476cd tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:41.176735 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-40052461-8ebe-4b0c-b398-3a08c78476cd tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:41.177493 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-40052461-8ebe-4b0c-b398-3a08c78476cd tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:41.178450 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-40052461-8ebe-4b0c-b398-3a08c78476cd tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:41.199229 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-cf4f90c6-8e19-4183-9fb3-92fb2ef6527f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:41.199739 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-cf4f90c6-8e19-4183-9fb3-92fb2ef6527f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:41.205631 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cf4f90c6-8e19-4183-9fb3-92fb2ef6527f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:41.206105 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cf4f90c6-8e19-4183-9fb3-92fb2ef6527f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:41.206861 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cf4f90c6-8e19-4183-9fb3-92fb2ef6527f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:41.207280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cf4f90c6-8e19-4183-9fb3-92fb2ef6527f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:41.211917 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:41.366416 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-40052461-8ebe-4b0c-b398-3a08c78476cd tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:41.374096 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-40052461-8ebe-4b0c-b398-3a08c78476cd tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.207789 Jul 14 14:34:41.374667 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 220/427] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:41 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:41.389922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-cf4f90c6-8e19-4183-9fb3-92fb2ef6527f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:41.398319 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-cf4f90c6-8e19-4183-9fb3-92fb2ef6527f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1663 microversion: 2.1 time: 0.202983 Jul 14 14:34:41.398876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 208/428] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:41 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1663 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:42.182213 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-85ce256e-acec-4942-9455-5023ae466abd tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:42.182731 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-85ce256e-acec-4942-9455-5023ae466abd tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:42.189198 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-85ce256e-acec-4942-9455-5023ae466abd tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:42.189633 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-85ce256e-acec-4942-9455-5023ae466abd tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:42.190411 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-85ce256e-acec-4942-9455-5023ae466abd tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:42.190886 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-85ce256e-acec-4942-9455-5023ae466abd tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:42.191384 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-49c7cfcd-3ab5-4488-aa22-ff9cf40e4079 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:42.192009 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-49c7cfcd-3ab5-4488-aa22-ff9cf40e4079 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:42.198067 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-49c7cfcd-3ab5-4488-aa22-ff9cf40e4079 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:42.198513 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-49c7cfcd-3ab5-4488-aa22-ff9cf40e4079 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:42.199265 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-49c7cfcd-3ab5-4488-aa22-ff9cf40e4079 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:42.199691 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-49c7cfcd-3ab5-4488-aa22-ff9cf40e4079 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:42.387429 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-85ce256e-acec-4942-9455-5023ae466abd tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:42.390344 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-49c7cfcd-3ab5-4488-aa22-ff9cf40e4079 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:42.395234 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-85ce256e-acec-4942-9455-5023ae466abd tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1469 microversion: 2.1 time: 0.217494 Jul 14 14:34:42.395903 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 221/429] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:42 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1469 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:42.398267 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-49c7cfcd-3ab5-4488-aa22-ff9cf40e4079 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.211003 Jul 14 14:34:42.398981 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 209/430] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:42 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:42.400292 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-3b84f713-5618-43e1-ad65-299b87ad6bb9 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:42.400892 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-3b84f713-5618-43e1-ad65-299b87ad6bb9 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:42.406834 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b84f713-5618-43e1-ad65-299b87ad6bb9 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:42.407281 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b84f713-5618-43e1-ad65-299b87ad6bb9 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:42.408035 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b84f713-5618-43e1-ad65-299b87ad6bb9 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:42.408465 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b84f713-5618-43e1-ad65-299b87ad6bb9 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:42.415546 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7f2da547-8cfa-45cf-9cad-a11060718a4d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:42.416150 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-7f2da547-8cfa-45cf-9cad-a11060718a4d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:42.422322 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7f2da547-8cfa-45cf-9cad-a11060718a4d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:42.422767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7f2da547-8cfa-45cf-9cad-a11060718a4d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:42.423520 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7f2da547-8cfa-45cf-9cad-a11060718a4d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:42.423949 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7f2da547-8cfa-45cf-9cad-a11060718a4d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:42.612104 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3b84f713-5618-43e1-ad65-299b87ad6bb9 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:42.616634 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=100 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:42.620990 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-3b84f713-5618-43e1-ad65-299b87ad6bb9 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.224133 Jul 14 14:34:42.631542 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 222/431] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:42 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:42.632035 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7f2da547-8cfa-45cf-9cad-a11060718a4d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:42.633530 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-7f2da547-8cfa-45cf-9cad-a11060718a4d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1663 microversion: 2.1 time: 0.222197 Jul 14 14:34:42.634123 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 210/432] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:42 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1663 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:43.412550 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b6c72bfc-ad3d-4b7a-af1b-5ef89948e724 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:43.413064 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b6c72bfc-ad3d-4b7a-af1b-5ef89948e724 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:43.415183 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e74ada88-6472-4a55-b95b-9c9354b56119 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:43.415572 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e74ada88-6472-4a55-b95b-9c9354b56119 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:43.420565 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b6c72bfc-ad3d-4b7a-af1b-5ef89948e724 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.421015 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b6c72bfc-ad3d-4b7a-af1b-5ef89948e724 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.421552 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e74ada88-6472-4a55-b95b-9c9354b56119 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.421805 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b6c72bfc-ad3d-4b7a-af1b-5ef89948e724 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.422186 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e74ada88-6472-4a55-b95b-9c9354b56119 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.422326 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b6c72bfc-ad3d-4b7a-af1b-5ef89948e724 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.423228 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e74ada88-6472-4a55-b95b-9c9354b56119 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.423658 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e74ada88-6472-4a55-b95b-9c9354b56119 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.616433 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b6c72bfc-ad3d-4b7a-af1b-5ef89948e724 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:43.620790 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e74ada88-6472-4a55-b95b-9c9354b56119 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:43.624226 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b6c72bfc-ad3d-4b7a-af1b-5ef89948e724 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1469 microversion: 2.1 time: 0.215614 Jul 14 14:34:43.624803 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 223/433] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:43 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1469 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:43.628979 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e74ada88-6472-4a55-b95b-9c9354b56119 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.217899 Jul 14 14:34:43.629544 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 211/434] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:43 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:43.646289 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4a77dc34-b6ac-41f5-9689-69f7632e8209 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:43.646892 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-4a77dc34-b6ac-41f5-9689-69f7632e8209 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:43.650665 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-3b365c24-832e-4dc1-82fa-be007d14dac5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:43.651427 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-3b365c24-832e-4dc1-82fa-be007d14dac5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:43.652789 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4a77dc34-b6ac-41f5-9689-69f7632e8209 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.653235 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4a77dc34-b6ac-41f5-9689-69f7632e8209 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.654014 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4a77dc34-b6ac-41f5-9689-69f7632e8209 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.654476 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4a77dc34-b6ac-41f5-9689-69f7632e8209 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.658540 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3b365c24-832e-4dc1-82fa-be007d14dac5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.659219 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3b365c24-832e-4dc1-82fa-be007d14dac5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.660439 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3b365c24-832e-4dc1-82fa-be007d14dac5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:43.660917 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3b365c24-832e-4dc1-82fa-be007d14dac5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:43.854747 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4a77dc34-b6ac-41f5-9689-69f7632e8209 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:43.864915 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-3b365c24-832e-4dc1-82fa-be007d14dac5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:43.867278 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4a77dc34-b6ac-41f5-9689-69f7632e8209 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.224515 Jul 14 14:34:43.868794 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 224/435] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:43 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:43.880579 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-3b365c24-832e-4dc1-82fa-be007d14dac5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1663 microversion: 2.1 time: 0.233950 Jul 14 14:34:43.881914 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 212/436] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:43 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1663 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:44.642010 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-37a8ec97-0dc7-4e7e-98cf-0f184aeb1455 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:44.642611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-37a8ec97-0dc7-4e7e-98cf-0f184aeb1455 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:44.646351 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b041e11a-f1ca-4b1b-8b0d-30429eb5bb80 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:44.646967 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b041e11a-f1ca-4b1b-8b0d-30429eb5bb80 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:44.649574 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-37a8ec97-0dc7-4e7e-98cf-0f184aeb1455 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.650046 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-37a8ec97-0dc7-4e7e-98cf-0f184aeb1455 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:44.650809 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-37a8ec97-0dc7-4e7e-98cf-0f184aeb1455 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.651239 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-37a8ec97-0dc7-4e7e-98cf-0f184aeb1455 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:44.656791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b041e11a-f1ca-4b1b-8b0d-30429eb5bb80 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.657375 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b041e11a-f1ca-4b1b-8b0d-30429eb5bb80 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:44.658805 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b041e11a-f1ca-4b1b-8b0d-30429eb5bb80 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.659606 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b041e11a-f1ca-4b1b-8b0d-30429eb5bb80 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:44.849453 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-37a8ec97-0dc7-4e7e-98cf-0f184aeb1455 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:44.859175 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b041e11a-f1ca-4b1b-8b0d-30429eb5bb80 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:44.859329 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-37a8ec97-0dc7-4e7e-98cf-0f184aeb1455 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1469 microversion: 2.1 time: 0.219872 Jul 14 14:34:44.859329 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 225/437] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:44 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1469 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:44.865968 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b041e11a-f1ca-4b1b-8b0d-30429eb5bb80 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.223541 Jul 14 14:34:44.866536 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 213/438] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:44 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:44.884267 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-5010a7d6-f2a7-49b6-bc9c-cabcf7c4dd9c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:44.884873 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-5010a7d6-f2a7-49b6-bc9c-cabcf7c4dd9c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:44.891185 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5010a7d6-f2a7-49b6-bc9c-cabcf7c4dd9c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.891622 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5010a7d6-f2a7-49b6-bc9c-cabcf7c4dd9c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:44.892425 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5010a7d6-f2a7-49b6-bc9c-cabcf7c4dd9c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.892803 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5010a7d6-f2a7-49b6-bc9c-cabcf7c4dd9c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:44.901428 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-24eee3e8-c54a-407c-8502-9303c0c3dcd0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:44.902210 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-24eee3e8-c54a-407c-8502-9303c0c3dcd0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:44.908490 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-24eee3e8-c54a-407c-8502-9303c0c3dcd0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.908943 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-24eee3e8-c54a-407c-8502-9303c0c3dcd0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:44.909741 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-24eee3e8-c54a-407c-8502-9303c0c3dcd0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:44.910193 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-24eee3e8-c54a-407c-8502-9303c0c3dcd0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:45.114597 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-24eee3e8-c54a-407c-8502-9303c0c3dcd0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:45.117636 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5010a7d6-f2a7-49b6-bc9c-cabcf7c4dd9c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:45.128062 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-5010a7d6-f2a7-49b6-bc9c-cabcf7c4dd9c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.245893 Jul 14 14:34:45.129150 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 226/439] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:44 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:45.133243 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-24eee3e8-c54a-407c-8502-9303c0c3dcd0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1663 microversion: 2.1 time: 0.236520 Jul 14 14:34:45.141966 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 214/440] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:44 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1663 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:45.577738 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-b2749675-0b08-4b00-bbf9-ff9c0ef62656 req-ee51d916-8c04-429b-a142-91f11a288f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d8e0d8-eb2a-465d-893a-8e60eb8222ec", "name": "network-vif-deleted", "tag": "d8288d41-d69a-403f-8513-8c7e6ea2347c"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:45.641877 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-b2749675-0b08-4b00-bbf9-ff9c0ef62656 req-ee51d916-8c04-429b-a142-91f11a288f00 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:45.641877 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-b2749675-0b08-4b00-bbf9-ff9c0ef62656 req-ee51d916-8c04-429b-a142-91f11a288f00 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:45.641877 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-b2749675-0b08-4b00-bbf9-ff9c0ef62656 req-ee51d916-8c04-429b-a142-91f11a288f00 service nova] Creating event network-vif-deleted:d8288d41-d69a-403f-8513-8c7e6ea2347c for instance 15d8e0d8-eb2a-465d-893a-8e60eb8222ec on hv-cinder-79987 Jul 14 14:34:45.641877 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-b2749675-0b08-4b00-bbf9-ff9c0ef62656 req-ee51d916-8c04-429b-a142-91f11a288f00 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030543 Jul 14 14:34:45.641877 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 227/441] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:45.875509 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-56de25de-69c3-41b3-90fe-3cc25f553ea1 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:45.876342 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-56de25de-69c3-41b3-90fe-3cc25f553ea1 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:45.888169 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-56de25de-69c3-41b3-90fe-3cc25f553ea1 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:45.888977 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-56de25de-69c3-41b3-90fe-3cc25f553ea1 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:45.890218 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b6680080-12b2-459c-99a1-5a242c7df0fe tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:45.890490 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-56de25de-69c3-41b3-90fe-3cc25f553ea1 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:45.891125 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-56de25de-69c3-41b3-90fe-3cc25f553ea1 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:45.891248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b6680080-12b2-459c-99a1-5a242c7df0fe tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:45.898292 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b6680080-12b2-459c-99a1-5a242c7df0fe tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:45.899262 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b6680080-12b2-459c-99a1-5a242c7df0fe tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:45.916008 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b6680080-12b2-459c-99a1-5a242c7df0fe tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:45.916008 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b6680080-12b2-459c-99a1-5a242c7df0fe tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:45.979988 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-56de25de-69c3-41b3-90fe-3cc25f553ea1 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:45.987675 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-56de25de-69c3-41b3-90fe-3cc25f553ea1 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1299 microversion: 2.1 time: 0.116230 Jul 14 14:34:45.988252 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 215/442] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:45 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:46.070977 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b6680080-12b2-459c-99a1-5a242c7df0fe tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:46.079011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b6680080-12b2-459c-99a1-5a242c7df0fe tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.200342 Jul 14 14:34:46.079578 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 228/443] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:45 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:46.144406 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-79cd6f00-6190-4e7c-b4bd-b574f9a95ca4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:46.145014 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-79cd6f00-6190-4e7c-b4bd-b574f9a95ca4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:46.150425 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-73ef384c-4c01-4f4f-8fdc-f5ec5ba69806 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:46.151035 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-73ef384c-4c01-4f4f-8fdc-f5ec5ba69806 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:46.151168 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-79cd6f00-6190-4e7c-b4bd-b574f9a95ca4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:46.151603 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-79cd6f00-6190-4e7c-b4bd-b574f9a95ca4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:46.152823 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-79cd6f00-6190-4e7c-b4bd-b574f9a95ca4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:46.153264 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-79cd6f00-6190-4e7c-b4bd-b574f9a95ca4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:46.158505 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-73ef384c-4c01-4f4f-8fdc-f5ec5ba69806 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:46.158505 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-73ef384c-4c01-4f4f-8fdc-f5ec5ba69806 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:46.158719 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-73ef384c-4c01-4f4f-8fdc-f5ec5ba69806 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:46.158978 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-73ef384c-4c01-4f4f-8fdc-f5ec5ba69806 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:46.357179 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-79cd6f00-6190-4e7c-b4bd-b574f9a95ca4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:46.359979 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-73ef384c-4c01-4f4f-8fdc-f5ec5ba69806 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:46.364733 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-79cd6f00-6190-4e7c-b4bd-b574f9a95ca4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.224235 Jul 14 14:34:46.365312 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 216/444] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:46 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:46.367694 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-73ef384c-4c01-4f4f-8fdc-f5ec5ba69806 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1667 microversion: 2.1 time: 0.221173 Jul 14 14:34:46.368253 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 229/445] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:46 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1667 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:47.006254 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-29d5591f-fbd7-4d18-9eb9-94d5b3b3b285 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:47.006901 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-29d5591f-fbd7-4d18-9eb9-94d5b3b3b285 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:47.013082 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-29d5591f-fbd7-4d18-9eb9-94d5b3b3b285 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.013518 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-29d5591f-fbd7-4d18-9eb9-94d5b3b3b285 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.014301 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-29d5591f-fbd7-4d18-9eb9-94d5b3b3b285 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.014720 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-29d5591f-fbd7-4d18-9eb9-94d5b3b3b285 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.044709 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-29d5591f-fbd7-4d18-9eb9-94d5b3b3b285 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.045174 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-29d5591f-fbd7-4d18-9eb9-94d5b3b3b285 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.045610 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-29d5591f-fbd7-4d18-9eb9-94d5b3b3b285 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lazy-loading 'fault' on Instance uuid 15d8e0d8-eb2a-465d-893a-8e60eb8222ec {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:34:47.090096 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-29d5591f-fbd7-4d18-9eb9-94d5b3b3b285 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:47.096297 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e958401e-25bd-4751-8ecc-fed6d3adf311 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:47.096901 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e958401e-25bd-4751-8ecc-fed6d3adf311 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:47.097732 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-29d5591f-fbd7-4d18-9eb9-94d5b3b3b285 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1304 microversion: 2.1 time: 0.095879 Jul 14 14:34:47.098317 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 217/446] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:47 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:47.103249 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e958401e-25bd-4751-8ecc-fed6d3adf311 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.103689 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e958401e-25bd-4751-8ecc-fed6d3adf311 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.104451 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e958401e-25bd-4751-8ecc-fed6d3adf311 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.104952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e958401e-25bd-4751-8ecc-fed6d3adf311 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.231807 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e958401e-25bd-4751-8ecc-fed6d3adf311 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:47.239725 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e958401e-25bd-4751-8ecc-fed6d3adf311 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.147296 Jul 14 14:34:47.240821 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 230/447] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:47 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:47.382584 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e64fafee-1b21-486a-b99b-c9efbdf6754f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:47.383190 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e64fafee-1b21-486a-b99b-c9efbdf6754f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:47.389280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e64fafee-1b21-486a-b99b-c9efbdf6754f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.389724 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e64fafee-1b21-486a-b99b-c9efbdf6754f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.390519 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e64fafee-1b21-486a-b99b-c9efbdf6754f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:47.390951 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e64fafee-1b21-486a-b99b-c9efbdf6754f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:47.521791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e64fafee-1b21-486a-b99b-c9efbdf6754f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:47.529194 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e64fafee-1b21-486a-b99b-c9efbdf6754f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.151176 Jul 14 14:34:47.529757 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 218/448] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:47 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:48.116031 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4a695988-8b2a-425f-9680-19a5ee6ce0ba tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:48.116663 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-4a695988-8b2a-425f-9680-19a5ee6ce0ba tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:48.123305 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4a695988-8b2a-425f-9680-19a5ee6ce0ba tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:48.123744 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4a695988-8b2a-425f-9680-19a5ee6ce0ba tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:48.124495 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4a695988-8b2a-425f-9680-19a5ee6ce0ba tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:48.124922 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4a695988-8b2a-425f-9680-19a5ee6ce0ba tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:48.155229 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4a695988-8b2a-425f-9680-19a5ee6ce0ba tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:48.155664 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4a695988-8b2a-425f-9680-19a5ee6ce0ba tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:48.156129 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.objects.instance [None req-4a695988-8b2a-425f-9680-19a5ee6ce0ba tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lazy-loading 'fault' on Instance uuid 15d8e0d8-eb2a-465d-893a-8e60eb8222ec {{(pid=118461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:34:48.196141 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4a695988-8b2a-425f-9680-19a5ee6ce0ba tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:48.203659 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4a695988-8b2a-425f-9680-19a5ee6ce0ba tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1304 microversion: 2.1 time: 0.092038 Jul 14 14:34:48.204222 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 231/449] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:48 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:48.257203 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-71e79f2e-87df-4cdc-b3c5-ab9757b3c01b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:48.257825 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-71e79f2e-87df-4cdc-b3c5-ab9757b3c01b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:48.264045 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-71e79f2e-87df-4cdc-b3c5-ab9757b3c01b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:48.264556 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-71e79f2e-87df-4cdc-b3c5-ab9757b3c01b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:48.265316 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-71e79f2e-87df-4cdc-b3c5-ab9757b3c01b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:48.265747 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-71e79f2e-87df-4cdc-b3c5-ab9757b3c01b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:48.395125 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-71e79f2e-87df-4cdc-b3c5-ab9757b3c01b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:48.402992 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-71e79f2e-87df-4cdc-b3c5-ab9757b3c01b tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.149781 Jul 14 14:34:48.403539 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 219/450] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:48 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:48.546578 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-02501b09-2f02-4d53-82ed-7bdddfa2ff07 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:48.547195 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-02501b09-2f02-4d53-82ed-7bdddfa2ff07 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:48.553931 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-02501b09-2f02-4d53-82ed-7bdddfa2ff07 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:48.554376 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-02501b09-2f02-4d53-82ed-7bdddfa2ff07 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:48.555133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-02501b09-2f02-4d53-82ed-7bdddfa2ff07 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:48.555564 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-02501b09-2f02-4d53-82ed-7bdddfa2ff07 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:48.685881 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-02501b09-2f02-4d53-82ed-7bdddfa2ff07 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:48.693283 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-02501b09-2f02-4d53-82ed-7bdddfa2ff07 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.150681 Jul 14 14:34:48.693853 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 232/451] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:48 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:49.220538 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7681cf65-9eee-473b-851e-3fb0e992f381 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:49.221143 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-7681cf65-9eee-473b-851e-3fb0e992f381 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:49.227175 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7681cf65-9eee-473b-851e-3fb0e992f381 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.227618 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7681cf65-9eee-473b-851e-3fb0e992f381 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.228366 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7681cf65-9eee-473b-851e-3fb0e992f381 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.228796 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7681cf65-9eee-473b-851e-3fb0e992f381 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.258906 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7681cf65-9eee-473b-851e-3fb0e992f381 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.259540 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7681cf65-9eee-473b-851e-3fb0e992f381 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.259764 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-7681cf65-9eee-473b-851e-3fb0e992f381 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lazy-loading 'fault' on Instance uuid 15d8e0d8-eb2a-465d-893a-8e60eb8222ec {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:34:49.300934 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7681cf65-9eee-473b-851e-3fb0e992f381 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4108ab2452684c819e93dabd4f9e7c98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50add55111c4427d94f06a3cf0555067', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:49.308985 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-7681cf65-9eee-473b-851e-3fb0e992f381 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 200 len: 1304 microversion: 2.1 time: 0.092305 Jul 14 14:34:49.309536 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 220/452] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:49 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:49.424915 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f96ac6cb-9648-46f5-ba63-6de97e4bf958 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:49.424915 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-f96ac6cb-9648-46f5-ba63-6de97e4bf958 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:49.430727 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f96ac6cb-9648-46f5-ba63-6de97e4bf958 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.431323 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f96ac6cb-9648-46f5-ba63-6de97e4bf958 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.432102 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f96ac6cb-9648-46f5-ba63-6de97e4bf958 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.432534 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f96ac6cb-9648-46f5-ba63-6de97e4bf958 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.585372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-f96ac6cb-9648-46f5-ba63-6de97e4bf958 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:49.594970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-f96ac6cb-9648-46f5-ba63-6de97e4bf958 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.178337 Jul 14 14:34:49.595593 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 233/453] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:49 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:49.650192 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-8be458c0-ad25-48d1-9b00-234bf0d71c7a req-53524e5e-9f56-4761-b0d2-03bec34d4c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19ce733-1092-4a21-9c56-5f3b570afb2d", "name": "network-vif-plugged", "status": "completed", "tag": "952e7af0-ae31-4c8d-891e-163bc4da7b6e"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:49.658333 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-8be458c0-ad25-48d1-9b00-234bf0d71c7a req-53524e5e-9f56-4761-b0d2-03bec34d4c70 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.665248 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-8be458c0-ad25-48d1-9b00-234bf0d71c7a req-53524e5e-9f56-4761-b0d2-03bec34d4c70 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.670223 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-8be458c0-ad25-48d1-9b00-234bf0d71c7a req-53524e5e-9f56-4761-b0d2-03bec34d4c70 service nova] Creating event network-vif-plugged:952e7af0-ae31-4c8d-891e-163bc4da7b6e for instance e19ce733-1092-4a21-9c56-5f3b570afb2d on hv-cinder-79987 Jul 14 14:34:49.675183 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-8be458c0-ad25-48d1-9b00-234bf0d71c7a req-53524e5e-9f56-4761-b0d2-03bec34d4c70 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029204 Jul 14 14:34:49.675764 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 221/454] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:49.710493 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-9e22067f-64cb-4f77-98dd-07a349737505 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:49.711133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-9e22067f-64cb-4f77-98dd-07a349737505 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:49.717496 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9e22067f-64cb-4f77-98dd-07a349737505 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.717968 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9e22067f-64cb-4f77-98dd-07a349737505 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.718741 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9e22067f-64cb-4f77-98dd-07a349737505 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:49.719199 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9e22067f-64cb-4f77-98dd-07a349737505 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:49.870049 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-9e22067f-64cb-4f77-98dd-07a349737505 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:49.878187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-9e22067f-64cb-4f77-98dd-07a349737505 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.172335 Jul 14 14:34:49.887927 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 234/455] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:49 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:50.326261 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d2348b27-a861-4cf1-91b5-967e734b65b0 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:50.326986 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-d2348b27-a861-4cf1-91b5-967e734b65b0 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] [instance: 15d8e0d8-eb2a-465d-893a-8e60eb8222ec] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:50.333447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d2348b27-a861-4cf1-91b5-967e734b65b0 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:50.333944 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d2348b27-a861-4cf1-91b5-967e734b65b0 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:50.334693 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d2348b27-a861-4cf1-91b5-967e734b65b0 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:50.335114 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d2348b27-a861-4cf1-91b5-967e734b65b0 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:50.348155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-d2348b27-a861-4cf1-91b5-967e734b65b0 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] HTTP exception thrown: Instance 15d8e0d8-eb2a-465d-893a-8e60eb8222ec could not be found. Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d2348b27-a861-4cf1-91b5-967e734b65b0 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Request method failure captured: Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec HTTP/1.1 Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0Clc9VneCulYv0QcNUXEV_tke__d2IYjC8uI3QCBwpqY_0cOJnsHHpLqrXVmxZ3hdIeYgRkjxW2tZqXokKNjmEfjAXo0k2qS-k88KShIptvymivWap5a9sNffR-VZBQtCMLUy3sZ7OXkn3JfaE3Yr5u3vuqk8wPt7YT7o_Et3fhn3rc Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: 50add55111c4427d94f06a3cf0555067 Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-VolumesNegativeTest-1904776728 Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:34:50.349758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:34:50.351365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_50add55111c4427d94f06a3cf0555067"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50add55111c4427d94f06a3cf0555067"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/50add55111c4427d94f06a3cf0555067"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/50add55111c4427d94f06a3cf0555067"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:34:50.351365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-VolumesNegativeTest-1904776728 Jul 14 14:34:50.351365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: 50add55111c4427d94f06a3cf0555067 Jul 14 14:34:50.351365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-VolumesNegativeTest-1904776728 Jul 14 14:34:50.351365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-VolumesNegativeTest-1904776728-project Jul 14 14:34:50.351365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:34:50.351365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:34:50.351365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 4108ab2452684c819e93dabd4f9e7c98 Jul 14 14:34:50.351365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-VolumesNegativeTest-1904776728-project Jul 14 14:34:50.351365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:34:50.351365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 15d8e0d8-eb2a-465d-893a-8e60eb8222ec could not be found. Jul 14 14:34:50.351365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '15d8e0d8-eb2a-465d-893a-8e60eb8222ec'} Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d8e0d8-eb2a-465d-893a-8e60eb8222ec could not be found. Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:50.352268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:50.353829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:50.353829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:34:50.353829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:34:50.353829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:34:50.353829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:34:50.353829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:34:50.353829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:34:50.353829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d8e0d8-eb2a-465d-893a-8e60eb8222ec could not be found. Jul 14 14:34:50.353829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:34:50.353829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:50.353829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:34:50.353829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:50.353829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:50.353829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:50.353829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:50.353829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:50.353829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d8e0d8-eb2a-465d-893a-8e60eb8222ec could not be found. Jul 14 14:34:50.353829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:34:50.355337 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d2348b27-a861-4cf1-91b5-967e734b65b0 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] Returning 404 to user: Instance 15d8e0d8-eb2a-465d-893a-8e60eb8222ec could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:50.355337 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-d2348b27-a861-4cf1-91b5-967e734b65b0 tempest-VolumesNegativeTest-1904776728 tempest-VolumesNegativeTest-1904776728-project] 10.222.0.93 "GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec" status: 404 len: 111 microversion: 2.1 time: 0.029166 Jul 14 14:34:50.355337 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 222/456] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:50 2022] GET /compute/v2.1/servers/15d8e0d8-eb2a-465d-893a-8e60eb8222ec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:34:50.613554 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4f2e1782-74f2-4838-971c-8a0387eb84f7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:50.614183 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-4f2e1782-74f2-4838-971c-8a0387eb84f7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:50.624525 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f2e1782-74f2-4838-971c-8a0387eb84f7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:50.625410 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f2e1782-74f2-4838-971c-8a0387eb84f7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:50.628400 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f2e1782-74f2-4838-971c-8a0387eb84f7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:50.628400 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f2e1782-74f2-4838-971c-8a0387eb84f7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:50.774221 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4f2e1782-74f2-4838-971c-8a0387eb84f7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:50.782446 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4f2e1782-74f2-4838-971c-8a0387eb84f7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1735 microversion: 2.1 time: 0.172793 Jul 14 14:34:50.783025 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 235/457] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:50 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:50.894807 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f301368d-fd2c-4bb2-851b-3493df3b1637 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:50.895440 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f301368d-fd2c-4bb2-851b-3493df3b1637 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:50.902000 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f301368d-fd2c-4bb2-851b-3493df3b1637 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:50.902443 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f301368d-fd2c-4bb2-851b-3493df3b1637 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:50.903193 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f301368d-fd2c-4bb2-851b-3493df3b1637 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:50.903617 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f301368d-fd2c-4bb2-851b-3493df3b1637 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:51.039983 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f301368d-fd2c-4bb2-851b-3493df3b1637 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:51.047776 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f301368d-fd2c-4bb2-851b-3493df3b1637 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.156877 Jul 14 14:34:51.050673 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 223/458] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:50 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:51.800418 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4b73af2e-7dfc-4ba1-9100-c53956747f21 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:51.801922 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-4b73af2e-7dfc-4ba1-9100-c53956747f21 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:51.810003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4b73af2e-7dfc-4ba1-9100-c53956747f21 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:51.810936 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4b73af2e-7dfc-4ba1-9100-c53956747f21 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:51.811220 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4b73af2e-7dfc-4ba1-9100-c53956747f21 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:51.811655 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4b73af2e-7dfc-4ba1-9100-c53956747f21 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:51.950314 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4b73af2e-7dfc-4ba1-9100-c53956747f21 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:51.958295 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4b73af2e-7dfc-4ba1-9100-c53956747f21 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1715 microversion: 2.1 time: 0.161894 Jul 14 14:34:51.959470 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 236/459] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:51 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1715 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:52.070803 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-2e360787-5c35-4f07-be57-41804b6f8263 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:52.078710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-2e360787-5c35-4f07-be57-41804b6f8263 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:52.084952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d0f3a3cb-7ca8-45dd-a637-092c450c0f0f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:52.085608 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d0f3a3cb-7ca8-45dd-a637-092c450c0f0f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:52.087448 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2e360787-5c35-4f07-be57-41804b6f8263 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.088039 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2e360787-5c35-4f07-be57-41804b6f8263 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.089032 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2e360787-5c35-4f07-be57-41804b6f8263 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.089651 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2e360787-5c35-4f07-be57-41804b6f8263 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.094085 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d0f3a3cb-7ca8-45dd-a637-092c450c0f0f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.094672 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d0f3a3cb-7ca8-45dd-a637-092c450c0f0f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.095444 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d0f3a3cb-7ca8-45dd-a637-092c450c0f0f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.097515 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d0f3a3cb-7ca8-45dd-a637-092c450c0f0f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.222684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-2e360787-5c35-4f07-be57-41804b6f8263 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:52.230848 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-d0f3a3cb-7ca8-45dd-a637-092c450c0f0f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] HTTP exception thrown: Cannot 'detach_volume' instance d79f9504-35ca-452e-8c51-8db181ea74a7 while it is in vm_state rescued Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d0f3a3cb-7ca8-45dd-a637-092c450c0f0f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Request method failure captured: Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: DELETE /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/os-volume_attachments/62a73395-7cf6-4783-a5ed-e5208ff733f8 HTTP/1.1 Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0Cib88DRNxeurZ4Wu63E6s9T4DzmysupyK-6SeWi0wmSzq8BtaTmQliX_wFDfdLOwcOIILWgDDf01bHrioVSVYNSAGBd7xCTidsz4QiE-OCIkB3iwTAouBCnn7EYZLaj3-JA8txDdBnqjbDI25rRz8H2tRvQ2ayihlDNB0SB6dUQjdw Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: e2578b0e75cb455c93cf83dfe54842ff Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-254252694 Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:34:52.232489 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:34:52.234081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:34:52.234081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-ServerRescueNegativeTestJSON-254252694 Jul 14 14:34:52.234081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: e2578b0e75cb455c93cf83dfe54842ff Jul 14 14:34:52.234081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-254252694 Jul 14 14:34:52.234081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-ServerRescueNegativeTestJSON-254252694-project Jul 14 14:34:52.234081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:34:52.234081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:34:52.234081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: be6cba32a31a425e964d7222c3d6b9fc Jul 14 14:34:52.234081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-ServerRescueNegativeTestJSON-254252694-project Jul 14 14:34:52.234081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:34:52.234081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Cannot 'detach_volume' instance d79f9504-35ca-452e-8c51-8db181ea74a7 while it is in vm_state rescued Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'server_id': 'd79f9504-35ca-452e-8c51-8db181ea74a7', 'id': '62a73395-7cf6-4783-a5ed-e5208ff733f8'} Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d79f9504-35ca-452e-8c51-8db181ea74a7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:34:52.234854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:34:52.236088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 14 14:34:52.236088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 14:34:52.236088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:34:52.236088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:34:52.236088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d79f9504-35ca-452e-8c51-8db181ea74a7 while it is in vm_state rescued Jul 14 14:34:52.236088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.236088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:34:52.236088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.236088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:34:52.236088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:34:52.236088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:34:52.236088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:34:52.236088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:34:52.236088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d79f9504-35ca-452e-8c51-8db181ea74a7 while it is in vm_state rescued Jul 14 14:34:52.236088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:34:52.236088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d0f3a3cb-7ca8-45dd-a637-092c450c0f0f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Returning 409 to user: Cannot 'detach_volume' instance d79f9504-35ca-452e-8c51-8db181ea74a7 while it is in vm_state rescued {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:34:52.237154 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d0f3a3cb-7ca8-45dd-a637-092c450c0f0f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/os-volume_attachments/62a73395-7cf6-4783-a5ed-e5208ff733f8" status: 409 len: 152 microversion: 2.1 time: 0.154150 Jul 14 14:34:52.237231 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-2e360787-5c35-4f07-be57-41804b6f8263 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1358 microversion: 2.1 time: 0.172279 Jul 14 14:34:52.237307 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 237/460] 10.222.0.93 () {58 vars in 1415 bytes} [Thu Jul 14 14:34:52 2022] DELETE /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/os-volume_attachments/62a73395-7cf6-4783-a5ed-e5208ff733f8 => generated 152 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 14 14:34:52.237379 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 224/461] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:52 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:52.243005 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d1f8e482-36a6-448f-8d6d-d53d58e97fcc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:52.247280 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d1f8e482-36a6-448f-8d6d-d53d58e97fcc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:52.250367 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d1f8e482-36a6-448f-8d6d-d53d58e97fcc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.250821 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d1f8e482-36a6-448f-8d6d-d53d58e97fcc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.251590 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d1f8e482-36a6-448f-8d6d-d53d58e97fcc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.252020 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d1f8e482-36a6-448f-8d6d-d53d58e97fcc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.391347 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:52.510373 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d1f8e482-36a6-448f-8d6d-d53d58e97fcc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "POST /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/action" status: 202 len: 0 microversion: 2.1 time: 0.271291 Jul 14 14:34:52.511111 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 238/462] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 14 14:34:52 2022] POST /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:34:52.520198 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-104da0a7-a869-491f-ab7f-fc714607ce11 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:52.520811 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-104da0a7-a869-491f-ab7f-fc714607ce11 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:52.528120 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-104da0a7-a869-491f-ab7f-fc714607ce11 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.528625 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-104da0a7-a869-491f-ab7f-fc714607ce11 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.529411 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-104da0a7-a869-491f-ab7f-fc714607ce11 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:52.530504 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-104da0a7-a869-491f-ab7f-fc714607ce11 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:52.548937 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=100 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:34:52.664406 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-104da0a7-a869-491f-ab7f-fc714607ce11 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:52.672630 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-104da0a7-a869-491f-ab7f-fc714607ce11 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1723 microversion: 2.1 time: 0.156709 Jul 14 14:34:52.673198 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 225/463] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:52 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:53.253432 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-6f93321b-0644-44c3-817f-a130eccd2599 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:53.254377 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-6f93321b-0644-44c3-817f-a130eccd2599 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:53.264720 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6f93321b-0644-44c3-817f-a130eccd2599 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.266191 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6f93321b-0644-44c3-817f-a130eccd2599 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.266921 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6f93321b-0644-44c3-817f-a130eccd2599 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.267354 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6f93321b-0644-44c3-817f-a130eccd2599 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.419183 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-6f93321b-0644-44c3-817f-a130eccd2599 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:53.427241 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-6f93321b-0644-44c3-817f-a130eccd2599 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1547 microversion: 2.1 time: 0.179324 Jul 14 14:34:53.428013 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 239/464] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:53 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1547 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:53.445666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e94633c6-c876-4bc9-bed8-0cb57158d979 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:53.446557 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e94633c6-c876-4bc9-bed8-0cb57158d979 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:53.453093 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e94633c6-c876-4bc9-bed8-0cb57158d979 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.453617 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e94633c6-c876-4bc9-bed8-0cb57158d979 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.454670 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e94633c6-c876-4bc9-bed8-0cb57158d979 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.455099 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e94633c6-c876-4bc9-bed8-0cb57158d979 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.598764 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e94633c6-c876-4bc9-bed8-0cb57158d979 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:53.606572 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e94633c6-c876-4bc9-bed8-0cb57158d979 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1547 microversion: 2.1 time: 0.165887 Jul 14 14:34:53.607181 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 226/465] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:53 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:53.623208 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e88af7c1-ec4e-435e-9b8b-390dfd2e8fd5 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:53.635168 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e88af7c1-ec4e-435e-9b8b-390dfd2e8fd5 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:53.635168 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e88af7c1-ec4e-435e-9b8b-390dfd2e8fd5 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Searching by: {'deleted': False, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b'} {{(pid=118461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:34:53.635763 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e88af7c1-ec4e-435e-9b8b-390dfd2e8fd5 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.636427 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e88af7c1-ec4e-435e-9b8b-390dfd2e8fd5 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.636776 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e88af7c1-ec4e-435e-9b8b-390dfd2e8fd5 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.637227 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e88af7c1-ec4e-435e-9b8b-390dfd2e8fd5 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.690079 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-cd72a328-4ecf-43f5-93ac-6ac19bcb346e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:53.690690 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-cd72a328-4ecf-43f5-93ac-6ac19bcb346e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:53.697266 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cd72a328-4ecf-43f5-93ac-6ac19bcb346e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.697714 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cd72a328-4ecf-43f5-93ac-6ac19bcb346e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.698666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cd72a328-4ecf-43f5-93ac-6ac19bcb346e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.699102 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cd72a328-4ecf-43f5-93ac-6ac19bcb346e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.733540 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.multi_cell_list [None req-e88af7c1-ec4e-435e-9b8b-390dfd2e8fd5 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:34:53.831887 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e88af7c1-ec4e-435e-9b8b-390dfd2e8fd5 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212931 Jul 14 14:34:53.832476 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 240/466] 10.222.0.93 () {58 vars in 1124 bytes} [Thu Jul 14 14:34:53 2022] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:53.843844 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0d191392-5b85-40b8-a4fa-3fe8946f5fbc tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:53.844466 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-0d191392-5b85-40b8-a4fa-3fe8946f5fbc tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:53.845514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-cd72a328-4ecf-43f5-93ac-6ac19bcb346e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:53.853920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-cd72a328-4ecf-43f5-93ac-6ac19bcb346e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1723 microversion: 2.1 time: 0.167653 Jul 14 14:34:53.854494 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 227/467] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:53 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:53.859826 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0d191392-5b85-40b8-a4fa-3fe8946f5fbc tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.860269 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0d191392-5b85-40b8-a4fa-3fe8946f5fbc tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:53.864156 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0d191392-5b85-40b8-a4fa-3fe8946f5fbc tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:53.864156 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0d191392-5b85-40b8-a4fa-3fe8946f5fbc tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:54.012524 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-0d191392-5b85-40b8-a4fa-3fe8946f5fbc tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:54.022270 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-0d191392-5b85-40b8-a4fa-3fe8946f5fbc tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1547 microversion: 2.1 time: 0.183082 Jul 14 14:34:54.023026 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 241/468] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:53 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1547 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:34:54.073474 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d5a2bf8e-986d-4d75-8bf5-92ccfa0d73f9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:54.074346 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-d5a2bf8e-986d-4d75-8bf5-92ccfa0d73f9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:54.086182 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d5a2bf8e-986d-4d75-8bf5-92ccfa0d73f9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:54.086632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d5a2bf8e-986d-4d75-8bf5-92ccfa0d73f9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:54.087408 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d5a2bf8e-986d-4d75-8bf5-92ccfa0d73f9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:54.087906 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d5a2bf8e-986d-4d75-8bf5-92ccfa0d73f9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:54.196504 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-d5a2bf8e-986d-4d75-8bf5-92ccfa0d73f9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lazy-loading 'services' on Instance uuid 9a74f940-a1d9-415c-a5ef-122576dd9e54 {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:34:54.540755 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-d5a2bf8e-986d-4d75-8bf5-92ccfa0d73f9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54/os-volume_attachments/9647ba3e-8b35-4c03-926a-ba03ea6948fc" status: 202 len: 0 microversion: 2.1 time: 0.471054 Jul 14 14:34:54.541532 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 228/469] 10.222.0.93 () {58 vars in 1415 bytes} [Thu Jul 14 14:34:54 2022] DELETE /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54/os-volume_attachments/9647ba3e-8b35-4c03-926a-ba03ea6948fc => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:34:54.879069 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d5024ba8-43e5-4faf-9647-976a4a38e6de tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:54.879765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d5024ba8-43e5-4faf-9647-976a4a38e6de tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:54.888651 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d5024ba8-43e5-4faf-9647-976a4a38e6de tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:54.889262 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d5024ba8-43e5-4faf-9647-976a4a38e6de tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:54.890077 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d5024ba8-43e5-4faf-9647-976a4a38e6de tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:54.892683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d5024ba8-43e5-4faf-9647-976a4a38e6de tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:55.038305 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d5024ba8-43e5-4faf-9647-976a4a38e6de tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:55.050791 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d5024ba8-43e5-4faf-9647-976a4a38e6de tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1723 microversion: 2.1 time: 0.183094 Jul 14 14:34:55.051400 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 242/470] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:54 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:56.070545 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-6a200f63-4d54-4b8c-b27b-6be7ed72d2ed tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:56.071273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-6a200f63-4d54-4b8c-b27b-6be7ed72d2ed tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:56.077722 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6a200f63-4d54-4b8c-b27b-6be7ed72d2ed tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:56.078195 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6a200f63-4d54-4b8c-b27b-6be7ed72d2ed tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:56.079010 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6a200f63-4d54-4b8c-b27b-6be7ed72d2ed tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:56.079446 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6a200f63-4d54-4b8c-b27b-6be7ed72d2ed tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:56.102563 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-fb59e4a1-7b3c-44bc-9f1f-ba7efef1193c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7535421-97bf-49e7-85e1-fde378d7dee7"}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:56.103669 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-fb59e4a1-7b3c-44bc-9f1f-ba7efef1193c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:56.110388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fb59e4a1-7b3c-44bc-9f1f-ba7efef1193c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:56.110837 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fb59e4a1-7b3c-44bc-9f1f-ba7efef1193c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:56.111607 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fb59e4a1-7b3c-44bc-9f1f-ba7efef1193c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:56.112045 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fb59e4a1-7b3c-44bc-9f1f-ba7efef1193c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:56.216203 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-6a200f63-4d54-4b8c-b27b-6be7ed72d2ed tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:56.224290 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-6a200f63-4d54-4b8c-b27b-6be7ed72d2ed tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1729 microversion: 2.1 time: 0.159232 Jul 14 14:34:56.225375 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 229/471] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:56 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:56.241375 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7e0cb107-6154-45ed-ae1a-7f63b1fadfd4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:56.241892 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-7e0cb107-6154-45ed-ae1a-7f63b1fadfd4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:56.247907 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7e0cb107-6154-45ed-ae1a-7f63b1fadfd4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:56.248347 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7e0cb107-6154-45ed-ae1a-7f63b1fadfd4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:56.249111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7e0cb107-6154-45ed-ae1a-7f63b1fadfd4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:56.249543 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7e0cb107-6154-45ed-ae1a-7f63b1fadfd4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:56.331035 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-7e0cb107-6154-45ed-ae1a-7f63b1fadfd4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093510 Jul 14 14:34:56.331626 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 230/472] 10.222.0.93 () {58 vars in 1274 bytes} [Thu Jul 14 14:34:56 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:34:56.746950 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-fe4692d1-5d52-44b6-a90e-c3183f10b8f8 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:56.747434 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-fe4692d1-5d52-44b6-a90e-c3183f10b8f8 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:56.753455 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fe4692d1-5d52-44b6-a90e-c3183f10b8f8 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:56.753925 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fe4692d1-5d52-44b6-a90e-c3183f10b8f8 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:56.754673 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fe4692d1-5d52-44b6-a90e-c3183f10b8f8 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:56.755096 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fe4692d1-5d52-44b6-a90e-c3183f10b8f8 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:56.780891 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-fe4692d1-5d52-44b6-a90e-c3183f10b8f8 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Going to try to terminate instance {{(pid=118462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:34:56.909257 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-fb59e4a1-7b3c-44bc-9f1f-ba7efef1193c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "POST /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.810359 Jul 14 14:34:56.914318 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 243/473] 10.222.0.93 () {60 vars in 1322 bytes} [Thu Jul 14 14:34:56 2022] POST /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d/os-volume_attachments => generated 194 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:34:57.113743 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-fe4692d1-5d52-44b6-a90e-c3183f10b8f8 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 204 len: 0 microversion: 2.1 time: 0.370400 Jul 14 14:34:57.116409 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 231/474] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:34:56 2022] DELETE /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:34:57.125538 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-dc8dc534-e6d8-400d-be76-595c8bd48f6b tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:57.126274 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-dc8dc534-e6d8-400d-be76-595c8bd48f6b tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:57.133900 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dc8dc534-e6d8-400d-be76-595c8bd48f6b tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:57.134354 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dc8dc534-e6d8-400d-be76-595c8bd48f6b tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:57.135119 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dc8dc534-e6d8-400d-be76-595c8bd48f6b tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:57.135772 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dc8dc534-e6d8-400d-be76-595c8bd48f6b tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:57.577008 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-dc8dc534-e6d8-400d-be76-595c8bd48f6b tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:57.593183 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-dc8dc534-e6d8-400d-be76-595c8bd48f6b tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 200 len: 1514 microversion: 2.1 time: 0.472469 Jul 14 14:34:57.594854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 244/475] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:57 2022] GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 1514 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:57.595232 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-0d8c86df-982e-4280-b89e-33d68a014b37 req-8670982c-61e7-4b8c-99f7-643a8da29e5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d79f9504-35ca-452e-8c51-8db181ea74a7", "tag": "1aed1e1d-edb5-41ea-ac88-358515dbc3f6"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:57.610877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-0d8c86df-982e-4280-b89e-33d68a014b37 req-8670982c-61e7-4b8c-99f7-643a8da29e5d service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:57.611665 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-0d8c86df-982e-4280-b89e-33d68a014b37 req-8670982c-61e7-4b8c-99f7-643a8da29e5d service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:57.634388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-0d8c86df-982e-4280-b89e-33d68a014b37 req-8670982c-61e7-4b8c-99f7-643a8da29e5d service nova] Creating event network-changed:1aed1e1d-edb5-41ea-ac88-358515dbc3f6 for instance d79f9504-35ca-452e-8c51-8db181ea74a7 on hv-cinder-79987 Jul 14 14:34:57.641160 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-0d8c86df-982e-4280-b89e-33d68a014b37 req-8670982c-61e7-4b8c-99f7-643a8da29e5d service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050431 Jul 14 14:34:57.642283 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 232/476] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:34:58.612033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d9d3d8fe-5c65-49a7-914e-9e81101a92af tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:58.612728 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d9d3d8fe-5c65-49a7-914e-9e81101a92af tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:58.619671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d9d3d8fe-5c65-49a7-914e-9e81101a92af tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:58.620145 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d9d3d8fe-5c65-49a7-914e-9e81101a92af tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:58.621124 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d9d3d8fe-5c65-49a7-914e-9e81101a92af tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:58.621553 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d9d3d8fe-5c65-49a7-914e-9e81101a92af tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:58.761251 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d9d3d8fe-5c65-49a7-914e-9e81101a92af tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:58.772239 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d9d3d8fe-5c65-49a7-914e-9e81101a92af tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 200 len: 1514 microversion: 2.1 time: 0.163443 Jul 14 14:34:58.773025 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 245/477] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:58 2022] GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:34:59.662258 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-854384f2-7957-4941-aa10-65f9590bfca6 req-819b6366-739f-4980-9c38-15a5eb4b87f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d79f9504-35ca-452e-8c51-8db181ea74a7", "tag": "1aed1e1d-edb5-41ea-ac88-358515dbc3f6"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:59.672116 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-854384f2-7957-4941-aa10-65f9590bfca6 req-819b6366-739f-4980-9c38-15a5eb4b87f5 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:59.672730 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-854384f2-7957-4941-aa10-65f9590bfca6 req-819b6366-739f-4980-9c38-15a5eb4b87f5 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:59.684668 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-854384f2-7957-4941-aa10-65f9590bfca6 req-819b6366-739f-4980-9c38-15a5eb4b87f5 service nova] Creating event network-changed:1aed1e1d-edb5-41ea-ac88-358515dbc3f6 for instance d79f9504-35ca-452e-8c51-8db181ea74a7 on hv-cinder-79987 Jul 14 14:34:59.690114 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-854384f2-7957-4941-aa10-65f9590bfca6 req-819b6366-739f-4980-9c38-15a5eb4b87f5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032509 Jul 14 14:34:59.691055 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 233/478] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:59.711414 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-fea3f3f1-5fd9-4a58-af2c-67f17393cdcd req-37287c56-7d37-4cdf-a5a3-f16b77c2ae12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a74f940-a1d9-415c-a5ef-122576dd9e54", "name": "network-vif-deleted", "tag": "5fca55be-c0f3-4146-b3bb-58ac04b68e9e"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:34:59.720116 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-fea3f3f1-5fd9-4a58-af2c-67f17393cdcd req-37287c56-7d37-4cdf-a5a3-f16b77c2ae12 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:59.720780 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-fea3f3f1-5fd9-4a58-af2c-67f17393cdcd req-37287c56-7d37-4cdf-a5a3-f16b77c2ae12 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:59.733141 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-fea3f3f1-5fd9-4a58-af2c-67f17393cdcd req-37287c56-7d37-4cdf-a5a3-f16b77c2ae12 service nova] Creating event network-vif-deleted:5fca55be-c0f3-4146-b3bb-58ac04b68e9e for instance 9a74f940-a1d9-415c-a5ef-122576dd9e54 on hv-cinder-79987 Jul 14 14:34:59.738093 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-fea3f3f1-5fd9-4a58-af2c-67f17393cdcd req-37287c56-7d37-4cdf-a5a3-f16b77c2ae12 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030860 Jul 14 14:34:59.739273 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 246/479] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:34:59.805595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-102b7ca5-adf9-4c92-84d1-01f4fb2d1820 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:34:59.805595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-102b7ca5-adf9-4c92-84d1-01f4fb2d1820 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:34:59.811067 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-102b7ca5-adf9-4c92-84d1-01f4fb2d1820 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:59.811518 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-102b7ca5-adf9-4c92-84d1-01f4fb2d1820 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:59.812429 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-102b7ca5-adf9-4c92-84d1-01f4fb2d1820 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:59.812915 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-102b7ca5-adf9-4c92-84d1-01f4fb2d1820 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:59.887497 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-102b7ca5-adf9-4c92-84d1-01f4fb2d1820 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:34:59.899798 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-102b7ca5-adf9-4c92-84d1-01f4fb2d1820 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 200 len: 1472 microversion: 2.1 time: 0.104574 Jul 14 14:34:59.900761 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 234/480] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:34:59 2022] GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 1472 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:00.919284 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c674e971-764a-48b8-b1a5-e32ae4a78d26 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:00.919978 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c674e971-764a-48b8-b1a5-e32ae4a78d26 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 9a74f940-a1d9-415c-a5ef-122576dd9e54] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:00.926203 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c674e971-764a-48b8-b1a5-e32ae4a78d26 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:00.926650 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c674e971-764a-48b8-b1a5-e32ae4a78d26 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:00.928007 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c674e971-764a-48b8-b1a5-e32ae4a78d26 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:00.928499 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c674e971-764a-48b8-b1a5-e32ae4a78d26 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:00.941907 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-c674e971-764a-48b8-b1a5-e32ae4a78d26 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] HTTP exception thrown: Instance 9a74f940-a1d9-415c-a5ef-122576dd9e54 could not be found. Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c674e971-764a-48b8-b1a5-e32ae4a78d26 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Request method failure captured: Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 HTTP/1.1 Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0Ck9MFFjm5j1Odooc52jV3Ot0bClGwhsfFs5cR_XTozmrnxCAC7TSnbebVmRwMOjoZW_lioQNQbbUJntN5Cvfz2a0N_zv4XDKLOeftkiVunvTDll4LmTXeNfJZ8mC8WoGFoy4IPNyDXwsL_DA6zH0FUn9Dh7M_6h9HdAo9_nBxiji3A Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: ceeb3ddff16645c6bd9ca8e138ed356f Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-VolumesSnapshotTestJSON-211992955 Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:35:00.946874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:35:00.948520 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ceeb3ddff16645c6bd9ca8e138ed356f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ceeb3ddff16645c6bd9ca8e138ed356f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ceeb3ddff16645c6bd9ca8e138ed356f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ceeb3ddff16645c6bd9ca8e138ed356f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:35:00.948520 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-VolumesSnapshotTestJSON-211992955 Jul 14 14:35:00.948520 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: ceeb3ddff16645c6bd9ca8e138ed356f Jul 14 14:35:00.948520 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-211992955 Jul 14 14:35:00.948520 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-VolumesSnapshotTestJSON-211992955-project Jul 14 14:35:00.948520 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:35:00.948520 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:35:00.948520 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: a1336e374bb542b7a036e3c0d0af54f3 Jul 14 14:35:00.948520 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-VolumesSnapshotTestJSON-211992955-project Jul 14 14:35:00.948520 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:35:00.948520 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Instance 9a74f940-a1d9-415c-a5ef-122576dd9e54 could not be found. Jul 14 14:35:00.948520 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': '9a74f940-a1d9-415c-a5ef-122576dd9e54'} Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a74f940-a1d9-415c-a5ef-122576dd9e54 could not be found. Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:00.949419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:00.950911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:00.950911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:35:00.950911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:35:00.950911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:35:00.950911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:35:00.950911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:35:00.950911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:00.950911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a74f940-a1d9-415c-a5ef-122576dd9e54 could not be found. Jul 14 14:35:00.950911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:35:00.950911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:00.950911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:35:00.950911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:00.950911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:00.950911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:00.950911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:00.950911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:00.950911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a74f940-a1d9-415c-a5ef-122576dd9e54 could not be found. Jul 14 14:35:00.950911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:35:00.952241 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c674e971-764a-48b8-b1a5-e32ae4a78d26 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Returning 404 to user: Instance 9a74f940-a1d9-415c-a5ef-122576dd9e54 could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:00.952241 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c674e971-764a-48b8-b1a5-e32ae4a78d26 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54" status: 404 len: 111 microversion: 2.1 time: 0.030582 Jul 14 14:35:00.952241 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 247/481] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:00 2022] GET /compute/v2.1/servers/9a74f940-a1d9-415c-a5ef-122576dd9e54 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:08.695115 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-cd16e7c3-0d8f-420f-b944-9f7186d3004e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:08.695732 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-cd16e7c3-0d8f-420f-b944-9f7186d3004e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:08.698206 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:08.703338 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cd16e7c3-0d8f-420f-b944-9f7186d3004e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:08.703775 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cd16e7c3-0d8f-420f-b944-9f7186d3004e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:08.704532 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cd16e7c3-0d8f-420f-b944-9f7186d3004e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:08.705061 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cd16e7c3-0d8f-420f-b944-9f7186d3004e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:08.843941 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-cd16e7c3-0d8f-420f-b944-9f7186d3004e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:08.852248 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-cd16e7c3-0d8f-420f-b944-9f7186d3004e tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1593 microversion: 2.1 time: 0.160912 Jul 14 14:35:08.852510 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 235/482] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:08 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1593 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:11.319603 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-6073292d-0e3d-49bc-8200-0420defb7da7 req-318e31db-66f4-4961-8b0e-f793bee50b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19ce733-1092-4a21-9c56-5f3b570afb2d", "tag": "952e7af0-ae31-4c8d-891e-163bc4da7b6e"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:11.326989 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:11.328008 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=90 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:11.328854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:11.331150 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-6073292d-0e3d-49bc-8200-0420defb7da7 req-318e31db-66f4-4961-8b0e-f793bee50b7b service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:11.334132 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-6073292d-0e3d-49bc-8200-0420defb7da7 req-318e31db-66f4-4961-8b0e-f793bee50b7b service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:11.344231 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-6073292d-0e3d-49bc-8200-0420defb7da7 req-318e31db-66f4-4961-8b0e-f793bee50b7b service nova] Creating event network-changed:952e7af0-ae31-4c8d-891e-163bc4da7b6e for instance e19ce733-1092-4a21-9c56-5f3b570afb2d on hv-cinder-79987 Jul 14 14:35:11.349237 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-6073292d-0e3d-49bc-8200-0420defb7da7 req-318e31db-66f4-4961-8b0e-f793bee50b7b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033888 Jul 14 14:35:11.350103 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 248/483] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:12.780989 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f5a9b3e7-52de-46a1-851c-dd08a53c4fe4 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1046288191", "imageRef": "7ea875a4-facb-4053-be2d-ff0080d2f3a0", "flavorRef": "452", "networks": [{"uuid": "db6609a6-02c2-495b-bdd0-7340fd7ba40c"}]}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:12.835635 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.network.neutron [None req-f5a9b3e7-52de-46a1-851c-dd08a53c4fe4 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] validate_networks() for [('db6609a6-02c2-495b-bdd0-7340fd7ba40c', None, None, None, None, None)] {{(pid=118462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:35:13.217051 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-f5a9b3e7-52de-46a1-851c-dd08a53c4fe4 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Flavor limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:35:13.217474 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-f5a9b3e7-52de-46a1-851c-dd08a53c4fe4 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Image limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:35:13.217983 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-f5a9b3e7-52de-46a1-851c-dd08a53c4fe4 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Flavor pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:35:13.218562 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-f5a9b3e7-52de-46a1-851c-dd08a53c4fe4 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Image pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:35:13.219335 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-f5a9b3e7-52de-46a1-851c-dd08a53c4fe4 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:35:13.228143 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f5a9b3e7-52de-46a1-851c-dd08a53c4fe4 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:13.228590 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f5a9b3e7-52de-46a1-851c-dd08a53c4fe4 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:13.229385 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f5a9b3e7-52de-46a1-851c-dd08a53c4fe4 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:13.229849 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f5a9b3e7-52de-46a1-851c-dd08a53c4fe4 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:13.248420 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-f5a9b3e7-52de-46a1-851c-dd08a53c4fe4 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Getting quotas for project ceeb3ddff16645c6bd9ca8e138ed356f. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:35:13.252734 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-f5a9b3e7-52de-46a1-851c-dd08a53c4fe4 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Getting quotas for user a1336e374bb542b7a036e3c0d0af54f3 and project ceeb3ddff16645c6bd9ca8e138ed356f. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:35:13.283177 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f5a9b3e7-52de-46a1-851c-dd08a53c4fe4 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Going to run 1 instances... {{(pid=118462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:35:13.285520 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f5a9b3e7-52de-46a1-851c-dd08a53c4fe4 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ea875a4-facb-4053-be2d-ff0080d2f3a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:35:13.455810 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f5a9b3e7-52de-46a1-851c-dd08a53c4fe4 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678609 Jul 14 14:35:13.456479 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 236/484] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:35:13.474915 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ec523160-bf4b-4f8c-b4d5-e4d041712323 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:13.474915 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-ec523160-bf4b-4f8c-b4d5-e4d041712323 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:13.528859 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-ec523160-bf4b-4f8c-b4d5-e4d041712323 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:13.549327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-ec523160-bf4b-4f8c-b4d5-e4d041712323 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c" status: 200 len: 1219 microversion: 2.1 time: 0.072421 Jul 14 14:35:13.549327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 249/485] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:13 2022] GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:14.492847 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-3f10759f-efa8-4588-9d0e-ab5cd2f59d52 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1629415736"}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:14.493379 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-3f10759f-efa8-4588-9d0e-ab5cd2f59d52 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:14.499618 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3f10759f-efa8-4588-9d0e-ab5cd2f59d52 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:14.500078 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3f10759f-efa8-4588-9d0e-ab5cd2f59d52 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:14.500879 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3f10759f-efa8-4588-9d0e-ab5cd2f59d52 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:14.501305 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3f10759f-efa8-4588-9d0e-ab5cd2f59d52 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:14.574106 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-2c0e53c1-cc2a-490d-b953-ec5692411e05 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:14.575157 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-2c0e53c1-cc2a-490d-b953-ec5692411e05 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:14.582942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2c0e53c1-cc2a-490d-b953-ec5692411e05 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:14.583394 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2c0e53c1-cc2a-490d-b953-ec5692411e05 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:14.586152 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2c0e53c1-cc2a-490d-b953-ec5692411e05 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:14.586152 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2c0e53c1-cc2a-490d-b953-ec5692411e05 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:14.637711 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.network.security_group_api [None req-3f10759f-efa8-4588-9d0e-ab5cd2f59d52 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Adding security group 3c343f85-3621-4b20-9be1-ea5b8c6477e9 to port 952e7af0-ae31-4c8d-891e-163bc4da7b6e Jul 14 14:35:14.656161 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-2c0e53c1-cc2a-490d-b953-ec5692411e05 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:14.663752 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-2c0e53c1-cc2a-490d-b953-ec5692411e05 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c" status: 200 len: 1223 microversion: 2.1 time: 0.101886 Jul 14 14:35:14.664319 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 250/486] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:14 2022] GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:15.212978 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-ae38b9d0-a2ba-48dc-90cd-ab28d3ce19b1 req-6f89ef22-ecac-49ee-ba9f-e8d815fb55b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19ce733-1092-4a21-9c56-5f3b570afb2d", "tag": "952e7af0-ae31-4c8d-891e-163bc4da7b6e"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:15.214449 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-3f10759f-efa8-4588-9d0e-ab5cd2f59d52 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "POST /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d/action" status: 202 len: 0 microversion: 2.1 time: 0.714635 Jul 14 14:35:15.215622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 237/487] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 14 14:35:14 2022] POST /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d/action => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:15.225053 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a05a51af-8216-4e50-8bf7-1f92c467266f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:15.227372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-ae38b9d0-a2ba-48dc-90cd-ab28d3ce19b1 req-6f89ef22-ecac-49ee-ba9f-e8d815fb55b3 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:15.227817 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-ae38b9d0-a2ba-48dc-90cd-ab28d3ce19b1 req-6f89ef22-ecac-49ee-ba9f-e8d815fb55b3 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:15.227925 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a05a51af-8216-4e50-8bf7-1f92c467266f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:15.234888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a05a51af-8216-4e50-8bf7-1f92c467266f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:15.238132 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a05a51af-8216-4e50-8bf7-1f92c467266f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:15.238132 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a05a51af-8216-4e50-8bf7-1f92c467266f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:15.238132 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a05a51af-8216-4e50-8bf7-1f92c467266f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:15.249713 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-ae38b9d0-a2ba-48dc-90cd-ab28d3ce19b1 req-6f89ef22-ecac-49ee-ba9f-e8d815fb55b3 service nova] Creating event network-changed:952e7af0-ae31-4c8d-891e-163bc4da7b6e for instance e19ce733-1092-4a21-9c56-5f3b570afb2d on hv-cinder-79987 Jul 14 14:35:15.263866 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-ae38b9d0-a2ba-48dc-90cd-ab28d3ce19b1 req-6f89ef22-ecac-49ee-ba9f-e8d815fb55b3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054477 Jul 14 14:35:15.264910 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 251/488] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:15.425996 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a05a51af-8216-4e50-8bf7-1f92c467266f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:15.435546 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a05a51af-8216-4e50-8bf7-1f92c467266f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1758 microversion: 2.1 time: 0.215364 Jul 14 14:35:15.440037 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 238/489] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:15 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1758 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:15.681476 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-931f7de2-9322-4935-baf4-3e7f9f50c1fc tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:15.682188 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-931f7de2-9322-4935-baf4-3e7f9f50c1fc tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:15.688473 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-931f7de2-9322-4935-baf4-3e7f9f50c1fc tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:15.688900 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-931f7de2-9322-4935-baf4-3e7f9f50c1fc tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:15.689874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-931f7de2-9322-4935-baf4-3e7f9f50c1fc tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:15.690309 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-931f7de2-9322-4935-baf4-3e7f9f50c1fc tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:15.761799 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-931f7de2-9322-4935-baf4-3e7f9f50c1fc tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:15.769557 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-931f7de2-9322-4935-baf4-3e7f9f50c1fc tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c" status: 200 len: 1271 microversion: 2.1 time: 0.092707 Jul 14 14:35:15.772444 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 252/490] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:15 2022] GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:16.789390 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-8123d9b0-9e44-47d4-8ac4-1bf0f9ae6e99 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:16.790094 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-8123d9b0-9e44-47d4-8ac4-1bf0f9ae6e99 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:16.796381 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8123d9b0-9e44-47d4-8ac4-1bf0f9ae6e99 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:16.796825 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8123d9b0-9e44-47d4-8ac4-1bf0f9ae6e99 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:16.797589 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8123d9b0-9e44-47d4-8ac4-1bf0f9ae6e99 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:16.798045 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8123d9b0-9e44-47d4-8ac4-1bf0f9ae6e99 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:16.931688 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-8123d9b0-9e44-47d4-8ac4-1bf0f9ae6e99 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:16.939347 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-8123d9b0-9e44-47d4-8ac4-1bf0f9ae6e99 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c" status: 200 len: 1319 microversion: 2.1 time: 0.154688 Jul 14 14:35:16.939921 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 239/491] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:16 2022] GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:17.666207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-2e64afda-031d-415f-bf70-6e0d16ee8d5a req-4fe2024b-9086-4b41-be98-ea1cde171790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64f04c79-b2ea-48d2-bea5-41c631a8e63c", "tag": "de354651-c5b6-4cfd-b538-bcf04cdfa541"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:17.674636 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-2e64afda-031d-415f-bf70-6e0d16ee8d5a req-4fe2024b-9086-4b41-be98-ea1cde171790 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:17.676166 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-2e64afda-031d-415f-bf70-6e0d16ee8d5a req-4fe2024b-9086-4b41-be98-ea1cde171790 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:17.685959 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-2e64afda-031d-415f-bf70-6e0d16ee8d5a req-4fe2024b-9086-4b41-be98-ea1cde171790 service nova] Creating event network-changed:de354651-c5b6-4cfd-b538-bcf04cdfa541 for instance 64f04c79-b2ea-48d2-bea5-41c631a8e63c on hv-cinder-79987 Jul 14 14:35:17.690448 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-2e64afda-031d-415f-bf70-6e0d16ee8d5a req-4fe2024b-9086-4b41-be98-ea1cde171790 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028715 Jul 14 14:35:17.691233 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 253/492] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:35:17.956836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7fd5321e-a5e7-445b-9c8b-b3b2c051742c tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:17.957611 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-7fd5321e-a5e7-445b-9c8b-b3b2c051742c tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:17.965208 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7fd5321e-a5e7-445b-9c8b-b3b2c051742c tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:17.965803 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7fd5321e-a5e7-445b-9c8b-b3b2c051742c tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:17.967942 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7fd5321e-a5e7-445b-9c8b-b3b2c051742c tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:17.967942 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7fd5321e-a5e7-445b-9c8b-b3b2c051742c tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:18.104334 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7fd5321e-a5e7-445b-9c8b-b3b2c051742c tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:18.112602 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-7fd5321e-a5e7-445b-9c8b-b3b2c051742c tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c" status: 200 len: 1319 microversion: 2.1 time: 0.159832 Jul 14 14:35:18.113183 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 240/493] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:17 2022] GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:19.130507 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0c615c53-cbc0-4090-8424-069d73cbbe7f tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:19.131292 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-0c615c53-cbc0-4090-8424-069d73cbbe7f tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:19.137435 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0c615c53-cbc0-4090-8424-069d73cbbe7f tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:19.137915 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0c615c53-cbc0-4090-8424-069d73cbbe7f tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:19.138665 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0c615c53-cbc0-4090-8424-069d73cbbe7f tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:19.139095 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0c615c53-cbc0-4090-8424-069d73cbbe7f tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:19.270218 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-0c615c53-cbc0-4090-8424-069d73cbbe7f tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:19.278527 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-0c615c53-cbc0-4090-8424-069d73cbbe7f tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c" status: 200 len: 1319 microversion: 2.1 time: 0.152689 Jul 14 14:35:19.279092 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 254/494] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:19 2022] GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:20.295926 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-70b02ca1-7dd9-4c47-a1cc-bc4f632532e5 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:20.296511 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-70b02ca1-7dd9-4c47-a1cc-bc4f632532e5 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:20.303117 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-70b02ca1-7dd9-4c47-a1cc-bc4f632532e5 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:20.303551 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-70b02ca1-7dd9-4c47-a1cc-bc4f632532e5 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:20.304284 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-70b02ca1-7dd9-4c47-a1cc-bc4f632532e5 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:20.304705 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-70b02ca1-7dd9-4c47-a1cc-bc4f632532e5 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:20.439306 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-70b02ca1-7dd9-4c47-a1cc-bc4f632532e5 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:20.446697 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-70b02ca1-7dd9-4c47-a1cc-bc4f632532e5 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c" status: 200 len: 1319 microversion: 2.1 time: 0.154660 Jul 14 14:35:20.447260 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 241/495] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:20 2022] GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:21.463772 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e449ce19-fe84-4ccb-ba6c-5207347b3ff9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:21.464377 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e449ce19-fe84-4ccb-ba6c-5207347b3ff9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:21.470807 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e449ce19-fe84-4ccb-ba6c-5207347b3ff9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:21.471251 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e449ce19-fe84-4ccb-ba6c-5207347b3ff9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:21.472000 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e449ce19-fe84-4ccb-ba6c-5207347b3ff9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:21.472426 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e449ce19-fe84-4ccb-ba6c-5207347b3ff9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:21.600238 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e449ce19-fe84-4ccb-ba6c-5207347b3ff9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:21.608033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e449ce19-fe84-4ccb-ba6c-5207347b3ff9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c" status: 200 len: 1319 microversion: 2.1 time: 0.148122 Jul 14 14:35:21.608604 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 255/496] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:21 2022] GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:21.778843 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-5a38d6c4-6309-44c6-94f3-9645deaf075f req-626c04df-24b7-4042-9252-5a35909ef84f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f04c79-b2ea-48d2-bea5-41c631a8e63c", "name": "network-vif-plugged", "status": "completed", "tag": "de354651-c5b6-4cfd-b538-bcf04cdfa541"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:21.787447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-5a38d6c4-6309-44c6-94f3-9645deaf075f req-626c04df-24b7-4042-9252-5a35909ef84f service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:21.787883 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-5a38d6c4-6309-44c6-94f3-9645deaf075f req-626c04df-24b7-4042-9252-5a35909ef84f service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:21.798676 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-5a38d6c4-6309-44c6-94f3-9645deaf075f req-626c04df-24b7-4042-9252-5a35909ef84f service nova] Creating event network-vif-plugged:de354651-c5b6-4cfd-b538-bcf04cdfa541 for instance 64f04c79-b2ea-48d2-bea5-41c631a8e63c on hv-cinder-79987 Jul 14 14:35:21.804234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-5a38d6c4-6309-44c6-94f3-9645deaf075f req-626c04df-24b7-4042-9252-5a35909ef84f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029372 Jul 14 14:35:21.804857 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 242/497] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:35:22.625284 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ada3bf34-0a50-4be0-87e0-ed4df9b830a2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:22.625949 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-ada3bf34-0a50-4be0-87e0-ed4df9b830a2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:22.632456 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ada3bf34-0a50-4be0-87e0-ed4df9b830a2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:22.632904 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ada3bf34-0a50-4be0-87e0-ed4df9b830a2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:22.633655 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ada3bf34-0a50-4be0-87e0-ed4df9b830a2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:22.634114 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ada3bf34-0a50-4be0-87e0-ed4df9b830a2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:22.764783 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-ada3bf34-0a50-4be0-87e0-ed4df9b830a2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:22.772683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-ada3bf34-0a50-4be0-87e0-ed4df9b830a2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c" status: 200 len: 1319 microversion: 2.1 time: 0.151305 Jul 14 14:35:22.773247 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 256/498] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:22 2022] GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:23.787566 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=2 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:23.788864 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=6 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:23.796130 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-6195107a-386d-4d84-8f3b-083260a361e3 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:23.797243 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-6195107a-386d-4d84-8f3b-083260a361e3 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:23.804839 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6195107a-386d-4d84-8f3b-083260a361e3 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:23.805630 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6195107a-386d-4d84-8f3b-083260a361e3 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:23.811082 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6195107a-386d-4d84-8f3b-083260a361e3 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:23.811082 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6195107a-386d-4d84-8f3b-083260a361e3 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:23.811082 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:23.945665 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-6195107a-386d-4d84-8f3b-083260a361e3 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:23.953173 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-6195107a-386d-4d84-8f3b-083260a361e3 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c" status: 200 len: 1319 microversion: 2.1 time: 0.167249 Jul 14 14:35:23.953741 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 243/499] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:23 2022] GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:24.970233 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-799a65c0-96db-4aee-91e7-bd052fb0cabe tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:24.970842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-799a65c0-96db-4aee-91e7-bd052fb0cabe tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:24.972839 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:24.978270 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-799a65c0-96db-4aee-91e7-bd052fb0cabe tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:24.978714 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-799a65c0-96db-4aee-91e7-bd052fb0cabe tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:24.979475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-799a65c0-96db-4aee-91e7-bd052fb0cabe tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:24.980206 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-799a65c0-96db-4aee-91e7-bd052fb0cabe tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:25.110967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-799a65c0-96db-4aee-91e7-bd052fb0cabe tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:25.118834 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-799a65c0-96db-4aee-91e7-bd052fb0cabe tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c" status: 200 len: 1508 microversion: 2.1 time: 0.152501 Jul 14 14:35:25.119457 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 257/500] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:24 2022] GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:25.135733 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-be088359-b282-482c-802d-fb96a67d45f0 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c616ab7f-6e9c-4520-bebc-7b949e324093", "device": "/dev/sdb"}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:25.137306 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-be088359-b282-482c-802d-fb96a67d45f0 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:25.143968 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-be088359-b282-482c-802d-fb96a67d45f0 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:25.144411 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-be088359-b282-482c-802d-fb96a67d45f0 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:25.145157 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-be088359-b282-482c-802d-fb96a67d45f0 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:25.145585 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-be088359-b282-482c-802d-fb96a67d45f0 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:26.018623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-be088359-b282-482c-802d-fb96a67d45f0 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "POST /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.886657 Jul 14 14:35:26.019325 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 244/501] 10.222.0.93 () {60 vars in 1322 bytes} [Thu Jul 14 14:35:25 2022] POST /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c/os-volume_attachments => generated 194 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:28.307587 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ca9a20b0-3502-4ab3-8662-52fe677c9660 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:28.308534 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-ca9a20b0-3502-4ab3-8662-52fe677c9660 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:28.315100 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ca9a20b0-3502-4ab3-8662-52fe677c9660 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:28.315484 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ca9a20b0-3502-4ab3-8662-52fe677c9660 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:28.316228 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ca9a20b0-3502-4ab3-8662-52fe677c9660 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:28.316663 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ca9a20b0-3502-4ab3-8662-52fe677c9660 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:28.355277 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-ca9a20b0-3502-4ab3-8662-52fe677c9660 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051053 Jul 14 14:35:28.355852 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 258/502] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:35:28 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:35:28.412858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b5e2a050-a9a2-4655-8c5e-6df4a04ef01d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:28.413426 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b5e2a050-a9a2-4655-8c5e-6df4a04ef01d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:28.419695 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b5e2a050-a9a2-4655-8c5e-6df4a04ef01d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:28.420126 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b5e2a050-a9a2-4655-8c5e-6df4a04ef01d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:28.420867 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b5e2a050-a9a2-4655-8c5e-6df4a04ef01d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:28.421289 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b5e2a050-a9a2-4655-8c5e-6df4a04ef01d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:28.446145 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b5e2a050-a9a2-4655-8c5e-6df4a04ef01d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Going to try to terminate instance {{(pid=118462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:35:28.797995 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b5e2a050-a9a2-4655-8c5e-6df4a04ef01d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "DELETE /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 204 len: 0 microversion: 2.1 time: 0.389813 Jul 14 14:35:28.798602 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 245/503] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:35:28 2022] DELETE /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:35:28.806658 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-cce66571-fc95-44bd-b398-cca86c1edb9d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:28.807256 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-cce66571-fc95-44bd-b398-cca86c1edb9d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:28.813387 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cce66571-fc95-44bd-b398-cca86c1edb9d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:28.813864 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cce66571-fc95-44bd-b398-cca86c1edb9d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:28.814606 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cce66571-fc95-44bd-b398-cca86c1edb9d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:28.815028 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cce66571-fc95-44bd-b398-cca86c1edb9d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:28.949654 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-cce66571-fc95-44bd-b398-cca86c1edb9d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:28.957127 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-cce66571-fc95-44bd-b398-cca86c1edb9d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1673 microversion: 2.1 time: 0.154210 Jul 14 14:35:28.957687 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 259/504] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:28 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:29.976206 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-79654023-b12a-40bd-98c4-219830d717d1 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:29.976882 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-79654023-b12a-40bd-98c4-219830d717d1 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:29.983787 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-79654023-b12a-40bd-98c4-219830d717d1 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:29.984231 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-79654023-b12a-40bd-98c4-219830d717d1 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:29.984993 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-79654023-b12a-40bd-98c4-219830d717d1 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:29.985426 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-79654023-b12a-40bd-98c4-219830d717d1 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:30.113278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-79654023-b12a-40bd-98c4-219830d717d1 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:30.121330 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-79654023-b12a-40bd-98c4-219830d717d1 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1673 microversion: 2.1 time: 0.149846 Jul 14 14:35:30.121936 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 246/505] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:29 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:31.139124 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-13884f6d-9f93-488c-8aeb-676caea5bf84 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:31.139728 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-13884f6d-9f93-488c-8aeb-676caea5bf84 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:31.146378 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-13884f6d-9f93-488c-8aeb-676caea5bf84 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:31.146825 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-13884f6d-9f93-488c-8aeb-676caea5bf84 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:31.147588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-13884f6d-9f93-488c-8aeb-676caea5bf84 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:31.148020 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-13884f6d-9f93-488c-8aeb-676caea5bf84 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:31.276731 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-13884f6d-9f93-488c-8aeb-676caea5bf84 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:31.284386 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-13884f6d-9f93-488c-8aeb-676caea5bf84 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1673 microversion: 2.1 time: 0.149219 Jul 14 14:35:31.284947 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 260/506] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:31 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:32.302226 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d50e6530-b3d4-49d2-9f3c-744425fc2569 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:32.303721 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-d50e6530-b3d4-49d2-9f3c-744425fc2569 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:32.315820 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d50e6530-b3d4-49d2-9f3c-744425fc2569 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:32.318231 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d50e6530-b3d4-49d2-9f3c-744425fc2569 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:32.318231 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d50e6530-b3d4-49d2-9f3c-744425fc2569 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:32.318231 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d50e6530-b3d4-49d2-9f3c-744425fc2569 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:32.441189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-36e9f641-76e2-45fd-a9a4-8fca1e2ab4d2 req-5d2be3df-9329-456f-ad08-6ad756a3dbe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43e8bc61-9b48-4f75-b6cf-c0c05b28aad0", "name": "network-vif-deleted", "tag": "8ef3b15c-bd64-4c1c-8a46-268bb86b551d"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:32.451973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-d50e6530-b3d4-49d2-9f3c-744425fc2569 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:32.465182 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-d50e6530-b3d4-49d2-9f3c-744425fc2569 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1606 microversion: 2.1 time: 0.161882 Jul 14 14:35:32.466935 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 247/507] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:32 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1606 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:32.468141 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-36e9f641-76e2-45fd-a9a4-8fca1e2ab4d2 req-5d2be3df-9329-456f-ad08-6ad756a3dbe7 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:32.468743 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-36e9f641-76e2-45fd-a9a4-8fca1e2ab4d2 req-5d2be3df-9329-456f-ad08-6ad756a3dbe7 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:32.482429 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-36e9f641-76e2-45fd-a9a4-8fca1e2ab4d2 req-5d2be3df-9329-456f-ad08-6ad756a3dbe7 service nova] Creating event network-vif-deleted:8ef3b15c-bd64-4c1c-8a46-268bb86b551d for instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 on hv-cinder-79987 Jul 14 14:35:32.487987 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-36e9f641-76e2-45fd-a9a4-8fca1e2ab4d2 req-5d2be3df-9329-456f-ad08-6ad756a3dbe7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050485 Jul 14 14:35:32.493369 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 261/508] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:33.483887 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d1a98490-f4b2-4436-a685-7308adcfff13 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:33.484489 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-d1a98490-f4b2-4436-a685-7308adcfff13 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:33.491332 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d1a98490-f4b2-4436-a685-7308adcfff13 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:33.491783 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d1a98490-f4b2-4436-a685-7308adcfff13 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:33.492567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d1a98490-f4b2-4436-a685-7308adcfff13 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:33.500642 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d1a98490-f4b2-4436-a685-7308adcfff13 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:33.530660 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d1a98490-f4b2-4436-a685-7308adcfff13 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:33.531215 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d1a98490-f4b2-4436-a685-7308adcfff13 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:33.531768 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-d1a98490-f4b2-4436-a685-7308adcfff13 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lazy-loading 'fault' on Instance uuid 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:35:33.574670 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-d1a98490-f4b2-4436-a685-7308adcfff13 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:33.583792 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-d1a98490-f4b2-4436-a685-7308adcfff13 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 200 len: 1328 microversion: 2.1 time: 0.103885 Jul 14 14:35:33.586431 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 248/509] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:33 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:34.605562 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-85f976e8-0027-4582-ad21-4bffb422e6f9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:34.606305 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-85f976e8-0027-4582-ad21-4bffb422e6f9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:34.612401 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-85f976e8-0027-4582-ad21-4bffb422e6f9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:34.612839 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-85f976e8-0027-4582-ad21-4bffb422e6f9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:34.613591 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-85f976e8-0027-4582-ad21-4bffb422e6f9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:34.614156 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-85f976e8-0027-4582-ad21-4bffb422e6f9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:34.627759 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-85f976e8-0027-4582-ad21-4bffb422e6f9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] HTTP exception thrown: Instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 could not be found. Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-85f976e8-0027-4582-ad21-4bffb422e6f9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Request method failure captured: Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 HTTP/1.1 Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0CiejYvQdm7CioGAfmFaY1tyNTzC-wiwt50-f7zbngkLYS_MC6u-RdS_msB2Ocbhg_7Y8HNAehAdTHtVrXgXGUo8Wyp2mKxTrhzydp1SjehMS1c7DQxhMp3qiqGfSyfHQ9tfFUwxrzfoRKtITeMjfGO5rSmzTM1YPtLlX3gZvYj03FQ Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: 9f707e1171364031b016d16a10efda78 Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-AttachVolumeTestJSON-277404979 Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:35:34.629375 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:35:34.631021 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9f707e1171364031b016d16a10efda78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9f707e1171364031b016d16a10efda78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9f707e1171364031b016d16a10efda78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9f707e1171364031b016d16a10efda78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:35:34.631021 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-AttachVolumeTestJSON-277404979 Jul 14 14:35:34.631021 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: 9f707e1171364031b016d16a10efda78 Jul 14 14:35:34.631021 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-AttachVolumeTestJSON-277404979 Jul 14 14:35:34.631021 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-AttachVolumeTestJSON-277404979-project Jul 14 14:35:34.631021 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:35:34.631021 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:35:34.631021 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: bc26c3a3096b4b318d18d4c919f7a60a Jul 14 14:35:34.631021 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-AttachVolumeTestJSON-277404979-project Jul 14 14:35:34.631021 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:35:34.631021 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 could not be found. Jul 14 14:35:34.631021 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': '43e8bc61-9b48-4f75-b6cf-c0c05b28aad0'} Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 could not be found. Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:34.631950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:34.633717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:34.633717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:35:34.633717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:35:34.633717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:35:34.633717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:35:34.633717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:35:34.633717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:34.633717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 could not be found. Jul 14 14:35:34.633717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.633717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:34.633717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.633717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.633717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:34.633717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:34.633717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:34.633717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:34.633717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 could not be found. Jul 14 14:35:34.633717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.635710 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-85f976e8-0027-4582-ad21-4bffb422e6f9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Returning 404 to user: Instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:34.636551 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-85f976e8-0027-4582-ad21-4bffb422e6f9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 404 len: 111 microversion: 2.1 time: 0.036475 Jul 14 14:35:34.637711 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 262/510] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:34 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:34.647872 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e6cb3238-d87a-4fed-b875-979b8dfde697 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '.version_select at 0x7f416c5e8790>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:34.759189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e6cb3238-d87a-4fed-b875-979b8dfde697 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596622070" status: 202 len: 0 microversion: 2.1 time: 0.116363 Jul 14 14:35:34.759780 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 249/511] 10.222.0.93 () {58 vars in 1220 bytes} [Thu Jul 14 14:35:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596622070 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:35.579014 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-9099378d-be1a-4731-b092-ea7955563528 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Action: 'create', calling method: .version_select at 0x7f415fbbdca0>, body: {"keypair": {"name": "tempest-keypair-1660765399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEaAKJuJIxtrIu3G1YJg2A4WDHJjFVGFxKIYVfLVBur1EfWfb8BaB7fzZnz1Q5STCQPEVtgfpGhlZySeolGU0ULOyiMfYWyEYyua5FpPV1mIwAiS8eajOJ63ZtpwRRfeQ=="}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:35.593157 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-9099378d-be1a-4731-b092-ea7955563528 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Getting quotas for project 9f707e1171364031b016d16a10efda78. Resources: {'key_pairs'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:35:35.596862 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-9099378d-be1a-4731-b092-ea7955563528 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Getting quotas for user bc26c3a3096b4b318d18d4c919f7a60a and project 9f707e1171364031b016d16a10efda78. Resources: {'key_pairs'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:35:35.764601 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-9099378d-be1a-4731-b092-ea7955563528 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.189373 Jul 14 14:35:35.765261 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 263/512] 10.222.0.93 () {60 vars in 1158 bytes} [Thu Jul 14 14:35:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:38.016114 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-174a0a65-311a-466c-b483-e738f529916a tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:38.017629 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-174a0a65-311a-466c-b483-e738f529916a tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:38.025483 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-174a0a65-311a-466c-b483-e738f529916a tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:38.025822 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-174a0a65-311a-466c-b483-e738f529916a tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:38.026905 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-174a0a65-311a-466c-b483-e738f529916a tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:38.027370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-174a0a65-311a-466c-b483-e738f529916a tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:38.356188 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-174a0a65-311a-466c-b483-e738f529916a tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "POST /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d/action" status: 202 len: 0 microversion: 2.1 time: 0.343810 Jul 14 14:35:38.360150 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 250/513] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 14 14:35:38 2022] POST /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:38.366596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-766c99a0-eb7c-4c70-b56a-6229fb435dd0 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:38.367735 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-766c99a0-eb7c-4c70-b56a-6229fb435dd0 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:38.375365 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-766c99a0-eb7c-4c70-b56a-6229fb435dd0 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:38.375811 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-766c99a0-eb7c-4c70-b56a-6229fb435dd0 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:38.376563 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-766c99a0-eb7c-4c70-b56a-6229fb435dd0 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:38.376987 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-766c99a0-eb7c-4c70-b56a-6229fb435dd0 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:38.454705 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-dffd4e09-49a9-416e-9bdf-178a2552a940 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:38.455434 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-dffd4e09-49a9-416e-9bdf-178a2552a940 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:38.465494 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-dffd4e09-49a9-416e-9bdf-178a2552a940 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:38.466008 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-dffd4e09-49a9-416e-9bdf-178a2552a940 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:38.470264 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-dffd4e09-49a9-416e-9bdf-178a2552a940 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:38.470264 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-dffd4e09-49a9-416e-9bdf-178a2552a940 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:38.535872 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-766c99a0-eb7c-4c70-b56a-6229fb435dd0 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:38.546613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-766c99a0-eb7c-4c70-b56a-6229fb435dd0 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1750 microversion: 2.1 time: 0.184984 Jul 14 14:35:38.548415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 264/514] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:38 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1750 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:38.573523 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-dffd4e09-49a9-416e-9bdf-178a2552a940 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lazy-loading 'services' on Instance uuid d79f9504-35ca-452e-8c51-8db181ea74a7 {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:35:38.628110 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-83e4aa3e-81d8-4bb9-96ea-7e3d7a4a6951 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-569816774", "imageRef": "7ea875a4-facb-4053-be2d-ff0080d2f3a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbfe63db-9252-4dec-a8a5-e4a436973249"}], "security_groups": [{"name": "tempest-securitygroup--825266007"}], "key_name": "tempest-keypair-1660765399", "user_data": "}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:38.730759 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.network.neutron [None req-83e4aa3e-81d8-4bb9-96ea-7e3d7a4a6951 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] validate_networks() for [('bbfe63db-9252-4dec-a8a5-e4a436973249', None, None, None, None, None)] {{(pid=118461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:35:38.840227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-dffd4e09-49a9-416e-9bdf-178a2552a940 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/os-volume_attachments/62a73395-7cf6-4783-a5ed-e5208ff733f8" status: 202 len: 0 microversion: 2.1 time: 0.389742 Jul 14 14:35:38.840964 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 251/515] 10.222.0.93 () {58 vars in 1415 bytes} [Thu Jul 14 14:35:38 2022] DELETE /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/os-volume_attachments/62a73395-7cf6-4783-a5ed-e5208ff733f8 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:35:38.852126 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-3d06a829-d117-49fb-b383-e2492d5021f7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:38.852126 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-3d06a829-d117-49fb-b383-e2492d5021f7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:38.858466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3d06a829-d117-49fb-b383-e2492d5021f7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:38.859158 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3d06a829-d117-49fb-b383-e2492d5021f7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:38.860093 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3d06a829-d117-49fb-b383-e2492d5021f7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:38.860684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3d06a829-d117-49fb-b383-e2492d5021f7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:38.892150 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-3d06a829-d117-49fb-b383-e2492d5021f7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046746 Jul 14 14:35:38.892720 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 252/516] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:35:38 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:35:39.127120 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-83e4aa3e-81d8-4bb9-96ea-7e3d7a4a6951 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Flavor limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:35:39.127536 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-83e4aa3e-81d8-4bb9-96ea-7e3d7a4a6951 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Image limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:35:39.128002 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-83e4aa3e-81d8-4bb9-96ea-7e3d7a4a6951 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Flavor pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:35:39.128403 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-83e4aa3e-81d8-4bb9-96ea-7e3d7a4a6951 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Image pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:35:39.128816 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-83e4aa3e-81d8-4bb9-96ea-7e3d7a4a6951 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:35:39.137697 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-83e4aa3e-81d8-4bb9-96ea-7e3d7a4a6951 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:39.138169 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-83e4aa3e-81d8-4bb9-96ea-7e3d7a4a6951 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:39.139304 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-83e4aa3e-81d8-4bb9-96ea-7e3d7a4a6951 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:39.139482 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-83e4aa3e-81d8-4bb9-96ea-7e3d7a4a6951 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:39.156209 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-83e4aa3e-81d8-4bb9-96ea-7e3d7a4a6951 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Getting quotas for project 9f707e1171364031b016d16a10efda78. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:35:39.160406 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-83e4aa3e-81d8-4bb9-96ea-7e3d7a4a6951 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Getting quotas for user bc26c3a3096b4b318d18d4c919f7a60a and project 9f707e1171364031b016d16a10efda78. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:35:39.171804 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-83e4aa3e-81d8-4bb9-96ea-7e3d7a4a6951 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Going to run 1 instances... {{(pid=118461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:35:39.174064 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-83e4aa3e-81d8-4bb9-96ea-7e3d7a4a6951 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ea875a4-facb-4053-be2d-ff0080d2f3a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:35:39.319189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-83e4aa3e-81d8-4bb9-96ea-7e3d7a4a6951 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.695260 Jul 14 14:35:39.320114 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 265/517] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:35:39.330271 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b90a3fbc-4198-496e-92fc-f979c870d248 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:39.330863 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b90a3fbc-4198-496e-92fc-f979c870d248 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:39.569289 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-85ad4ae7-36bd-478d-b813-b0c6f84ee692 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:39.571521 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-85ad4ae7-36bd-478d-b813-b0c6f84ee692 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:39.578966 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-85ad4ae7-36bd-478d-b813-b0c6f84ee692 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:39.579404 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-85ad4ae7-36bd-478d-b813-b0c6f84ee692 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:39.580339 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-85ad4ae7-36bd-478d-b813-b0c6f84ee692 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:39.580798 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-85ad4ae7-36bd-478d-b813-b0c6f84ee692 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:39.583989 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b90a3fbc-4198-496e-92fc-f979c870d248 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:39.591567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b90a3fbc-4198-496e-92fc-f979c870d248 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1237 microversion: 2.1 time: 0.264991 Jul 14 14:35:39.592305 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 253/518] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:39 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1237 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:39.826308 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-85ad4ae7-36bd-478d-b813-b0c6f84ee692 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:39.834640 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-85ad4ae7-36bd-478d-b813-b0c6f84ee692 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1750 microversion: 2.1 time: 0.272130 Jul 14 14:35:39.837305 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 266/519] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:39 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1750 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:39.903285 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-8e8c4361-b614-4032-91c2-7dae31cc7284 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:39.904277 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-8e8c4361-b614-4032-91c2-7dae31cc7284 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:39.911182 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8e8c4361-b614-4032-91c2-7dae31cc7284 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:39.924129 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8e8c4361-b614-4032-91c2-7dae31cc7284 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:39.924129 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8e8c4361-b614-4032-91c2-7dae31cc7284 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:39.924129 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8e8c4361-b614-4032-91c2-7dae31cc7284 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:39.942194 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-8e8c4361-b614-4032-91c2-7dae31cc7284 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042834 Jul 14 14:35:39.942757 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 254/520] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:35:39 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:35:40.609871 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-5ae7efff-e136-4f28-a7e0-0a4f9be74ea0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:40.610463 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-5ae7efff-e136-4f28-a7e0-0a4f9be74ea0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:40.616616 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5ae7efff-e136-4f28-a7e0-0a4f9be74ea0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:40.617564 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5ae7efff-e136-4f28-a7e0-0a4f9be74ea0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:40.618364 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5ae7efff-e136-4f28-a7e0-0a4f9be74ea0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:40.618794 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5ae7efff-e136-4f28-a7e0-0a4f9be74ea0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:40.682338 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5ae7efff-e136-4f28-a7e0-0a4f9be74ea0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:40.689732 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-5ae7efff-e136-4f28-a7e0-0a4f9be74ea0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1241 microversion: 2.1 time: 0.084530 Jul 14 14:35:40.690326 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 267/521] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:40 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:40.852509 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-03b711f4-e06c-4f42-beca-9faeb4c53edb tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:40.853113 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-03b711f4-e06c-4f42-beca-9faeb4c53edb tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:40.859963 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-03b711f4-e06c-4f42-beca-9faeb4c53edb tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:40.860412 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-03b711f4-e06c-4f42-beca-9faeb4c53edb tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:40.861166 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-03b711f4-e06c-4f42-beca-9faeb4c53edb tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:40.861603 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-03b711f4-e06c-4f42-beca-9faeb4c53edb tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:40.954532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-21edbe72-54fc-4407-b5d5-bbb4999b3dce tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:40.955629 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-21edbe72-54fc-4407-b5d5-bbb4999b3dce tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:40.961950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-21edbe72-54fc-4407-b5d5-bbb4999b3dce tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:40.962514 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-21edbe72-54fc-4407-b5d5-bbb4999b3dce tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:40.963529 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-21edbe72-54fc-4407-b5d5-bbb4999b3dce tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:40.964025 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-21edbe72-54fc-4407-b5d5-bbb4999b3dce tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:40.995931 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-21edbe72-54fc-4407-b5d5-bbb4999b3dce tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045318 Jul 14 14:35:40.996640 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 268/522] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:35:40 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 14:35:41.010364 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-03b711f4-e06c-4f42-beca-9faeb4c53edb tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:41.019369 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-03b711f4-e06c-4f42-beca-9faeb4c53edb tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1755 microversion: 2.1 time: 0.170009 Jul 14 14:35:41.019369 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 255/523] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:40 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:41.072980 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-bdb055f6-1320-4d14-a2c7-cd47f76ff075 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:41.073650 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-bdb055f6-1320-4d14-a2c7-cd47f76ff075 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:41.080234 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bdb055f6-1320-4d14-a2c7-cd47f76ff075 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:41.085784 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bdb055f6-1320-4d14-a2c7-cd47f76ff075 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:41.085784 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bdb055f6-1320-4d14-a2c7-cd47f76ff075 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:41.085784 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bdb055f6-1320-4d14-a2c7-cd47f76ff075 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:41.110152 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-bdb055f6-1320-4d14-a2c7-cd47f76ff075 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Going to try to terminate instance {{(pid=118461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:35:41.137678 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=100 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:41.413295 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-bdb055f6-1320-4d14-a2c7-cd47f76ff075 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "DELETE /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 204 len: 0 microversion: 2.1 time: 0.344069 Jul 14 14:35:41.414496 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 269/524] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:35:41 2022] DELETE /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:35:41.422481 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-9c2ba4f6-7502-4fdd-8d91-254087a53825 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:41.423088 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-9c2ba4f6-7502-4fdd-8d91-254087a53825 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:41.428998 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9c2ba4f6-7502-4fdd-8d91-254087a53825 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:41.429442 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9c2ba4f6-7502-4fdd-8d91-254087a53825 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:41.430301 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9c2ba4f6-7502-4fdd-8d91-254087a53825 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:41.430729 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9c2ba4f6-7502-4fdd-8d91-254087a53825 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:41.563240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-9c2ba4f6-7502-4fdd-8d91-254087a53825 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:41.565519 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:41.571465 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-9c2ba4f6-7502-4fdd-8d91-254087a53825 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1689 microversion: 2.1 time: 0.152781 Jul 14 14:35:41.572039 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 256/525] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:41 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:41.707823 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-665979e4-63b3-4437-ab84-307c2159dc52 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:41.708506 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-665979e4-63b3-4437-ab84-307c2159dc52 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:41.715366 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-665979e4-63b3-4437-ab84-307c2159dc52 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:41.715806 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-665979e4-63b3-4437-ab84-307c2159dc52 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:41.716546 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-665979e4-63b3-4437-ab84-307c2159dc52 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:41.716971 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-665979e4-63b3-4437-ab84-307c2159dc52 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:41.779093 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-665979e4-63b3-4437-ab84-307c2159dc52 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:41.786590 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-665979e4-63b3-4437-ab84-307c2159dc52 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1241 microversion: 2.1 time: 0.082995 Jul 14 14:35:41.787148 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 270/526] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:41 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:42.036998 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-563b5106-14af-41ee-98bc-2a3847ffa834 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:42.037600 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-563b5106-14af-41ee-98bc-2a3847ffa834 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:42.045030 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-563b5106-14af-41ee-98bc-2a3847ffa834 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:42.045552 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-563b5106-14af-41ee-98bc-2a3847ffa834 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:42.046336 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-563b5106-14af-41ee-98bc-2a3847ffa834 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:42.046766 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-563b5106-14af-41ee-98bc-2a3847ffa834 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:42.195323 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-563b5106-14af-41ee-98bc-2a3847ffa834 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:42.203234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-563b5106-14af-41ee-98bc-2a3847ffa834 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1755 microversion: 2.1 time: 0.170504 Jul 14 14:35:42.205489 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 257/527] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:42 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:42.589020 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4d90c6ff-7537-4d9c-ba92-320f7b2eb655 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:42.589609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-4d90c6ff-7537-4d9c-ba92-320f7b2eb655 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:42.595627 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4d90c6ff-7537-4d9c-ba92-320f7b2eb655 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:42.596091 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4d90c6ff-7537-4d9c-ba92-320f7b2eb655 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:42.596831 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4d90c6ff-7537-4d9c-ba92-320f7b2eb655 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:42.597254 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4d90c6ff-7537-4d9c-ba92-320f7b2eb655 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:42.721882 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4d90c6ff-7537-4d9c-ba92-320f7b2eb655 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:42.729488 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4d90c6ff-7537-4d9c-ba92-320f7b2eb655 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1689 microversion: 2.1 time: 0.144974 Jul 14 14:35:42.730356 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 271/528] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:42 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1689 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:42.802886 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-5edd5ea7-5fd9-4c22-857c-affc5c37eaf0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:42.803516 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-5edd5ea7-5fd9-4c22-857c-affc5c37eaf0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:42.805331 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:42.810069 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5edd5ea7-5fd9-4c22-857c-affc5c37eaf0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:42.810500 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5edd5ea7-5fd9-4c22-857c-affc5c37eaf0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:42.811250 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5edd5ea7-5fd9-4c22-857c-affc5c37eaf0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:42.811673 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5edd5ea7-5fd9-4c22-857c-affc5c37eaf0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:42.873257 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-5edd5ea7-5fd9-4c22-857c-affc5c37eaf0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:42.880332 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-5edd5ea7-5fd9-4c22-857c-affc5c37eaf0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1233 microversion: 2.1 time: 0.081186 Jul 14 14:35:42.880880 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 258/529] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:42 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1233 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:43.220512 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b6d4b865-6287-4011-8c7a-fd6f1968432f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:43.221031 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b6d4b865-6287-4011-8c7a-fd6f1968432f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:43.227547 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b6d4b865-6287-4011-8c7a-fd6f1968432f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:43.227991 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b6d4b865-6287-4011-8c7a-fd6f1968432f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:43.228733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b6d4b865-6287-4011-8c7a-fd6f1968432f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:43.229202 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b6d4b865-6287-4011-8c7a-fd6f1968432f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:43.369712 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b6d4b865-6287-4011-8c7a-fd6f1968432f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:43.377848 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b6d4b865-6287-4011-8c7a-fd6f1968432f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1755 microversion: 2.1 time: 0.161266 Jul 14 14:35:43.389223 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 272/530] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:43 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:43.746727 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-8c193f7e-fc7c-4c68-8452-d02d7d7a9eff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:43.747285 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-8c193f7e-fc7c-4c68-8452-d02d7d7a9eff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:43.754468 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8c193f7e-fc7c-4c68-8452-d02d7d7a9eff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:43.754917 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8c193f7e-fc7c-4c68-8452-d02d7d7a9eff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:43.755677 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8c193f7e-fc7c-4c68-8452-d02d7d7a9eff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:43.756136 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8c193f7e-fc7c-4c68-8452-d02d7d7a9eff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:43.889437 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-8c193f7e-fc7c-4c68-8452-d02d7d7a9eff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:43.896884 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-8c193f7e-fc7c-4c68-8452-d02d7d7a9eff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1689 microversion: 2.1 time: 0.154033 Jul 14 14:35:43.898616 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 259/531] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:43 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:43.898729 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-6466951b-b831-468f-b0b9-ec907eb6ea5c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:43.899162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-6466951b-b831-468f-b0b9-ec907eb6ea5c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:43.902827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:43.906329 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6466951b-b831-468f-b0b9-ec907eb6ea5c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:43.906777 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6466951b-b831-468f-b0b9-ec907eb6ea5c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:43.907533 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6466951b-b831-468f-b0b9-ec907eb6ea5c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:43.907958 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6466951b-b831-468f-b0b9-ec907eb6ea5c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:43.969937 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-6466951b-b831-468f-b0b9-ec907eb6ea5c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:43.977965 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-6466951b-b831-468f-b0b9-ec907eb6ea5c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1233 microversion: 2.1 time: 0.083789 Jul 14 14:35:43.978536 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 273/532] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:43 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1233 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:44.395113 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a3316628-05ae-4f69-b45c-9feceaa49e9a tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:44.395627 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a3316628-05ae-4f69-b45c-9feceaa49e9a tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:44.401591 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a3316628-05ae-4f69-b45c-9feceaa49e9a tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:44.402142 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a3316628-05ae-4f69-b45c-9feceaa49e9a tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:44.402822 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a3316628-05ae-4f69-b45c-9feceaa49e9a tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:44.403250 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a3316628-05ae-4f69-b45c-9feceaa49e9a tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:44.559087 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a3316628-05ae-4f69-b45c-9feceaa49e9a tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:44.567052 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a3316628-05ae-4f69-b45c-9feceaa49e9a tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1755 microversion: 2.1 time: 0.175949 Jul 14 14:35:44.567610 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 260/533] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:44 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:44.915308 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-877e8e36-5d2c-4af2-ba68-7ae393649ee4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:44.915891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-877e8e36-5d2c-4af2-ba68-7ae393649ee4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:44.922992 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-877e8e36-5d2c-4af2-ba68-7ae393649ee4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:44.923437 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-877e8e36-5d2c-4af2-ba68-7ae393649ee4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:44.924193 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-877e8e36-5d2c-4af2-ba68-7ae393649ee4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:44.924620 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-877e8e36-5d2c-4af2-ba68-7ae393649ee4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:44.995583 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a3e8b719-03c1-496b-b489-a1bfaa8337e0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:44.996230 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a3e8b719-03c1-496b-b489-a1bfaa8337e0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:45.002798 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a3e8b719-03c1-496b-b489-a1bfaa8337e0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:45.003242 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a3e8b719-03c1-496b-b489-a1bfaa8337e0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:45.004008 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a3e8b719-03c1-496b-b489-a1bfaa8337e0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:45.004441 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a3e8b719-03c1-496b-b489-a1bfaa8337e0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:45.079167 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a3e8b719-03c1-496b-b489-a1bfaa8337e0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:45.086507 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-877e8e36-5d2c-4af2-ba68-7ae393649ee4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:45.086926 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a3e8b719-03c1-496b-b489-a1bfaa8337e0 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1233 microversion: 2.1 time: 0.096108 Jul 14 14:35:45.087577 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 261/534] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:44 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1233 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:45.094265 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-877e8e36-5d2c-4af2-ba68-7ae393649ee4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1689 microversion: 2.1 time: 0.183297 Jul 14 14:35:45.094836 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 274/535] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:44 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1689 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:45.584586 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-efb3e4af-6c23-4506-a717-702a1ca3fa13 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:45.585250 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-efb3e4af-6c23-4506-a717-702a1ca3fa13 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:45.591971 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-efb3e4af-6c23-4506-a717-702a1ca3fa13 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:45.592448 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-efb3e4af-6c23-4506-a717-702a1ca3fa13 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:45.593187 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-efb3e4af-6c23-4506-a717-702a1ca3fa13 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:45.593611 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-efb3e4af-6c23-4506-a717-702a1ca3fa13 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:45.734929 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-efb3e4af-6c23-4506-a717-702a1ca3fa13 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:45.743076 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-efb3e4af-6c23-4506-a717-702a1ca3fa13 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1755 microversion: 2.1 time: 0.162513 Jul 14 14:35:45.743680 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 262/536] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:45 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:46.103895 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d44e557b-88de-41ad-bcf1-96bdd60fdb42 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:46.104505 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d44e557b-88de-41ad-bcf1-96bdd60fdb42 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:46.111384 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d44e557b-88de-41ad-bcf1-96bdd60fdb42 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:46.111569 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0ba36b47-f990-457b-a0aa-2a25d1cd72e6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:46.111974 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d44e557b-88de-41ad-bcf1-96bdd60fdb42 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:46.112134 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0ba36b47-f990-457b-a0aa-2a25d1cd72e6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:46.112605 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d44e557b-88de-41ad-bcf1-96bdd60fdb42 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:46.113039 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d44e557b-88de-41ad-bcf1-96bdd60fdb42 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:46.119008 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ba36b47-f990-457b-a0aa-2a25d1cd72e6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:46.119452 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ba36b47-f990-457b-a0aa-2a25d1cd72e6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:46.120378 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ba36b47-f990-457b-a0aa-2a25d1cd72e6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:46.120811 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ba36b47-f990-457b-a0aa-2a25d1cd72e6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:46.194672 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d44e557b-88de-41ad-bcf1-96bdd60fdb42 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:46.203872 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d44e557b-88de-41ad-bcf1-96bdd60fdb42 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1233 microversion: 2.1 time: 0.103778 Jul 14 14:35:46.204738 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 275/537] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:46 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1233 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:46.279321 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-0ba36b47-f990-457b-a0aa-2a25d1cd72e6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:46.286930 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0ba36b47-f990-457b-a0aa-2a25d1cd72e6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1689 microversion: 2.1 time: 0.179067 Jul 14 14:35:46.287498 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 263/538] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:46 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:46.760200 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-070d58f5-8151-4d70-872e-f7f6395e7beb tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:46.765879 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-070d58f5-8151-4d70-872e-f7f6395e7beb tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:46.766687 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-070d58f5-8151-4d70-872e-f7f6395e7beb tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:46.767125 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-070d58f5-8151-4d70-872e-f7f6395e7beb tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:46.767870 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-070d58f5-8151-4d70-872e-f7f6395e7beb tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:46.768291 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-070d58f5-8151-4d70-872e-f7f6395e7beb tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:46.915204 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-070d58f5-8151-4d70-872e-f7f6395e7beb tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:46.926502 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-070d58f5-8151-4d70-872e-f7f6395e7beb tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1755 microversion: 2.1 time: 0.166937 Jul 14 14:35:46.926502 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 276/539] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:46 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:47.220668 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-05d53d38-168e-438e-aad2-0ad603450fd2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:47.221424 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-05d53d38-168e-438e-aad2-0ad603450fd2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:47.228716 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-05d53d38-168e-438e-aad2-0ad603450fd2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:47.233524 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-05d53d38-168e-438e-aad2-0ad603450fd2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:47.233524 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-05d53d38-168e-438e-aad2-0ad603450fd2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:47.233524 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-05d53d38-168e-438e-aad2-0ad603450fd2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:47.294946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-05d53d38-168e-438e-aad2-0ad603450fd2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:47.305138 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d57095fa-ecc4-4626-8888-b9ba4bef2978 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:47.305796 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d57095fa-ecc4-4626-8888-b9ba4bef2978 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:47.312629 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-05d53d38-168e-438e-aad2-0ad603450fd2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1297 microversion: 2.1 time: 0.095975 Jul 14 14:35:47.313142 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d57095fa-ecc4-4626-8888-b9ba4bef2978 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:47.313683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d57095fa-ecc4-4626-8888-b9ba4bef2978 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:47.314687 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d57095fa-ecc4-4626-8888-b9ba4bef2978 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:47.315250 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d57095fa-ecc4-4626-8888-b9ba4bef2978 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:47.322543 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 264/540] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:47 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1297 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:47.357867 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-50900512-f72e-4f5c-a83f-e72f8c1a1c1f tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:47.358661 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-50900512-f72e-4f5c-a83f-e72f8c1a1c1f tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:47.365538 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-50900512-f72e-4f5c-a83f-e72f8c1a1c1f tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:47.366280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-50900512-f72e-4f5c-a83f-e72f8c1a1c1f tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:47.367864 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-50900512-f72e-4f5c-a83f-e72f8c1a1c1f tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:47.368457 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-50900512-f72e-4f5c-a83f-e72f8c1a1c1f tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:47.470294 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-50900512-f72e-4f5c-a83f-e72f8c1a1c1f tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lazy-loading 'services' on Instance uuid 64f04c79-b2ea-48d2-bea5-41c631a8e63c {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:35:47.508723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d57095fa-ecc4-4626-8888-b9ba4bef2978 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:47.519003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d57095fa-ecc4-4626-8888-b9ba4bef2978 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1689 microversion: 2.1 time: 0.218272 Jul 14 14:35:47.519576 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 277/541] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:47 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1689 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:47.762669 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-50900512-f72e-4f5c-a83f-e72f8c1a1c1f tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "DELETE /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c/os-volume_attachments/c616ab7f-6e9c-4520-bebc-7b949e324093" status: 202 len: 0 microversion: 2.1 time: 0.409500 Jul 14 14:35:47.763287 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 265/542] 10.222.0.93 () {58 vars in 1415 bytes} [Thu Jul 14 14:35:47 2022] DELETE /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c/os-volume_attachments/c616ab7f-6e9c-4520-bebc-7b949e324093 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:35:47.940473 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c9e2cf79-a662-4c77-a720-9abdaa02b5ed tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:47.941130 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c9e2cf79-a662-4c77-a720-9abdaa02b5ed tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:47.947565 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c9e2cf79-a662-4c77-a720-9abdaa02b5ed tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:47.948013 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c9e2cf79-a662-4c77-a720-9abdaa02b5ed tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:47.948751 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c9e2cf79-a662-4c77-a720-9abdaa02b5ed tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:47.949176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c9e2cf79-a662-4c77-a720-9abdaa02b5ed tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:48.110549 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c9e2cf79-a662-4c77-a720-9abdaa02b5ed tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:48.120012 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c9e2cf79-a662-4c77-a720-9abdaa02b5ed tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1755 microversion: 2.1 time: 0.183398 Jul 14 14:35:48.121097 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 278/543] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:47 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:48.220664 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-25c9ba74-c6b1-4eba-8a79-c1d68374bb07 req-322e74f7-136b-4dcc-b809-cef17c0982bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d79f9504-35ca-452e-8c51-8db181ea74a7", "name": "network-vif-deleted", "tag": "1aed1e1d-edb5-41ea-ac88-358515dbc3f6"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:48.235472 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-25c9ba74-c6b1-4eba-8a79-c1d68374bb07 req-322e74f7-136b-4dcc-b809-cef17c0982bf service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:48.237214 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-25c9ba74-c6b1-4eba-8a79-c1d68374bb07 req-322e74f7-136b-4dcc-b809-cef17c0982bf service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:48.252413 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-25c9ba74-c6b1-4eba-8a79-c1d68374bb07 req-322e74f7-136b-4dcc-b809-cef17c0982bf service nova] Creating event network-vif-deleted:1aed1e1d-edb5-41ea-ac88-358515dbc3f6 for instance d79f9504-35ca-452e-8c51-8db181ea74a7 on hv-cinder-79987 Jul 14 14:35:48.258612 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-25c9ba74-c6b1-4eba-8a79-c1d68374bb07 req-322e74f7-136b-4dcc-b809-cef17c0982bf service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041273 Jul 14 14:35:48.259388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 266/544] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:48.331151 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-7f360f61-d7f8-4b38-a9e0-1e94af788f0c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:48.332469 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-7f360f61-d7f8-4b38-a9e0-1e94af788f0c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:48.339681 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7f360f61-d7f8-4b38-a9e0-1e94af788f0c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:48.340656 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7f360f61-d7f8-4b38-a9e0-1e94af788f0c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:48.341649 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7f360f61-d7f8-4b38-a9e0-1e94af788f0c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:48.342287 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7f360f61-d7f8-4b38-a9e0-1e94af788f0c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:48.412886 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7f360f61-d7f8-4b38-a9e0-1e94af788f0c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:48.421099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-7f360f61-d7f8-4b38-a9e0-1e94af788f0c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1295 microversion: 2.1 time: 0.095618 Jul 14 14:35:48.426182 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 279/545] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:48 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1295 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:48.539539 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-6db16ff0-b23b-40d4-bc9d-bfbbf86c4f87 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:48.540329 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-6db16ff0-b23b-40d4-bc9d-bfbbf86c4f87 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:48.548007 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6db16ff0-b23b-40d4-bc9d-bfbbf86c4f87 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:48.548917 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6db16ff0-b23b-40d4-bc9d-bfbbf86c4f87 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:48.550024 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6db16ff0-b23b-40d4-bc9d-bfbbf86c4f87 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:48.550685 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6db16ff0-b23b-40d4-bc9d-bfbbf86c4f87 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:48.630678 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-6db16ff0-b23b-40d4-bc9d-bfbbf86c4f87 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:48.639354 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-6db16ff0-b23b-40d4-bc9d-bfbbf86c4f87 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1622 microversion: 2.1 time: 0.106194 Jul 14 14:35:48.639934 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 267/546] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:48 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1622 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:49.140863 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-52e3a045-d14f-43c9-b043-7f63888e0e42 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:49.141699 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-52e3a045-d14f-43c9-b043-7f63888e0e42 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:49.146914 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:49.152498 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-52e3a045-d14f-43c9-b043-7f63888e0e42 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:49.152937 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-52e3a045-d14f-43c9-b043-7f63888e0e42 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:49.153704 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-52e3a045-d14f-43c9-b043-7f63888e0e42 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:49.157608 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-52e3a045-d14f-43c9-b043-7f63888e0e42 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:49.167283 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=10 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:49.328080 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-52e3a045-d14f-43c9-b043-7f63888e0e42 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:49.339421 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-52e3a045-d14f-43c9-b043-7f63888e0e42 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1755 microversion: 2.1 time: 0.206751 Jul 14 14:35:49.340758 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 280/547] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:49 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1755 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:49.438800 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-051a0da4-2a7c-47ad-9a15-22b34dada33c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:49.439395 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-051a0da4-2a7c-47ad-9a15-22b34dada33c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:49.446865 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-051a0da4-2a7c-47ad-9a15-22b34dada33c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:49.447312 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-051a0da4-2a7c-47ad-9a15-22b34dada33c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:49.448088 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-051a0da4-2a7c-47ad-9a15-22b34dada33c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:49.448519 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-051a0da4-2a7c-47ad-9a15-22b34dada33c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:49.589215 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=2 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:49.617826 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-051a0da4-2a7c-47ad-9a15-22b34dada33c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:49.627500 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-051a0da4-2a7c-47ad-9a15-22b34dada33c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1362 microversion: 2.1 time: 0.192371 Jul 14 14:35:49.628290 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 268/548] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:49 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:49.662021 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-3f9cf0ef-3473-469f-9b55-3db37b7a4eb2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:49.663213 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-3f9cf0ef-3473-469f-9b55-3db37b7a4eb2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:49.678257 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3f9cf0ef-3473-469f-9b55-3db37b7a4eb2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:49.680200 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3f9cf0ef-3473-469f-9b55-3db37b7a4eb2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:49.686454 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3f9cf0ef-3473-469f-9b55-3db37b7a4eb2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:49.686454 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3f9cf0ef-3473-469f-9b55-3db37b7a4eb2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:49.723042 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3f9cf0ef-3473-469f-9b55-3db37b7a4eb2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:49.723488 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3f9cf0ef-3473-469f-9b55-3db37b7a4eb2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:49.723943 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.objects.instance [None req-3f9cf0ef-3473-469f-9b55-3db37b7a4eb2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lazy-loading 'fault' on Instance uuid d79f9504-35ca-452e-8c51-8db181ea74a7 {{(pid=118461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:35:49.772482 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3f9cf0ef-3473-469f-9b55-3db37b7a4eb2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:49.782524 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-3f9cf0ef-3473-469f-9b55-3db37b7a4eb2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 200 len: 1335 microversion: 2.1 time: 0.129795 Jul 14 14:35:49.783140 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 281/549] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:49 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 1335 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:49.958035 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0c0089e7-fa2a-47e6-8e00-cc3fcd4397d2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:49.958782 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0c0089e7-fa2a-47e6-8e00-cc3fcd4397d2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:49.965374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0c0089e7-fa2a-47e6-8e00-cc3fcd4397d2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:49.965867 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0c0089e7-fa2a-47e6-8e00-cc3fcd4397d2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:49.966635 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0c0089e7-fa2a-47e6-8e00-cc3fcd4397d2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:49.967061 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0c0089e7-fa2a-47e6-8e00-cc3fcd4397d2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:49.994267 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0c0089e7-fa2a-47e6-8e00-cc3fcd4397d2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Going to try to terminate instance {{(pid=118462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:35:50.294647 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-5ad87dda-892c-48cb-9d95-71d6db840477 req-6559f03f-2c6a-46d7-ba35-67d2c8fa57e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911572ab-0885-4187-b3f7-4a62f1848c1d", "tag": "1036eb7e-e728-484f-95a0-13ba697cc1cc"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:50.302600 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-5ad87dda-892c-48cb-9d95-71d6db840477 req-6559f03f-2c6a-46d7-ba35-67d2c8fa57e9 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:50.303035 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-5ad87dda-892c-48cb-9d95-71d6db840477 req-6559f03f-2c6a-46d7-ba35-67d2c8fa57e9 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:50.313734 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-5ad87dda-892c-48cb-9d95-71d6db840477 req-6559f03f-2c6a-46d7-ba35-67d2c8fa57e9 service nova] Creating event network-changed:1036eb7e-e728-484f-95a0-13ba697cc1cc for instance 911572ab-0885-4187-b3f7-4a62f1848c1d on hv-cinder-79987 Jul 14 14:35:50.317630 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0c0089e7-fa2a-47e6-8e00-cc3fcd4397d2 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "DELETE /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c" status: 204 len: 0 microversion: 2.1 time: 0.363540 Jul 14 14:35:50.318261 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 269/550] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:35:49 2022] DELETE /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:35:50.322765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-5ad87dda-892c-48cb-9d95-71d6db840477 req-6559f03f-2c6a-46d7-ba35-67d2c8fa57e9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031551 Jul 14 14:35:50.329827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 282/551] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:35:50.330395 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-3de1bbd2-20b9-428a-905c-c659fb581d22 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:50.330395 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-3de1bbd2-20b9-428a-905c-c659fb581d22 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:50.334016 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3de1bbd2-20b9-428a-905c-c659fb581d22 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:50.334457 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3de1bbd2-20b9-428a-905c-c659fb581d22 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:50.335280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3de1bbd2-20b9-428a-905c-c659fb581d22 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:50.336351 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3de1bbd2-20b9-428a-905c-c659fb581d22 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:50.358808 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d74640e1-adab-48a8-821c-0ab355738957 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:50.359397 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d74640e1-adab-48a8-821c-0ab355738957 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:50.366225 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d74640e1-adab-48a8-821c-0ab355738957 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:50.367208 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d74640e1-adab-48a8-821c-0ab355738957 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:50.367960 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d74640e1-adab-48a8-821c-0ab355738957 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:50.368383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d74640e1-adab-48a8-821c-0ab355738957 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:50.518352 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-3de1bbd2-20b9-428a-905c-c659fb581d22 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:50.526280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-3de1bbd2-20b9-428a-905c-c659fb581d22 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c" status: 200 len: 1514 microversion: 2.1 time: 0.203007 Jul 14 14:35:50.526872 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 270/552] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:50 2022] GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:50.557446 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d74640e1-adab-48a8-821c-0ab355738957 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:50.566863 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d74640e1-adab-48a8-821c-0ab355738957 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1755 microversion: 2.1 time: 0.213777 Jul 14 14:35:50.567530 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 283/553] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:50 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1755 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:50.644554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e25f001e-b2f3-48f6-bbec-46bbb440eefc tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:50.645187 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e25f001e-b2f3-48f6-bbec-46bbb440eefc tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:50.651322 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e25f001e-b2f3-48f6-bbec-46bbb440eefc tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:50.653831 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e25f001e-b2f3-48f6-bbec-46bbb440eefc tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:50.653831 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e25f001e-b2f3-48f6-bbec-46bbb440eefc tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:50.653831 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e25f001e-b2f3-48f6-bbec-46bbb440eefc tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:50.784172 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e25f001e-b2f3-48f6-bbec-46bbb440eefc tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:50.786540 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:50.793104 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e25f001e-b2f3-48f6-bbec-46bbb440eefc tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1362 microversion: 2.1 time: 0.152507 Jul 14 14:35:50.793681 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 271/554] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:50 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:50.799281 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a55f1dfd-0a55-4a3f-839b-89edc3ec4221 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:50.799896 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a55f1dfd-0a55-4a3f-839b-89edc3ec4221 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: d79f9504-35ca-452e-8c51-8db181ea74a7] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:50.806490 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a55f1dfd-0a55-4a3f-839b-89edc3ec4221 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:50.806939 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a55f1dfd-0a55-4a3f-839b-89edc3ec4221 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:50.807732 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a55f1dfd-0a55-4a3f-839b-89edc3ec4221 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:50.808174 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a55f1dfd-0a55-4a3f-839b-89edc3ec4221 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:50.822972 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-a55f1dfd-0a55-4a3f-839b-89edc3ec4221 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] HTTP exception thrown: Instance d79f9504-35ca-452e-8c51-8db181ea74a7 could not be found. Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a55f1dfd-0a55-4a3f-839b-89edc3ec4221 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Request method failure captured: Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 HTTP/1.1 Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0Cib88DRNxeurZ4Wu63E6s9T4DzmysupyK-6SeWi0wmSzq8BtaTmQliX_wFDfdLOwcOIILWgDDf01bHrioVSVYNSAGBd7xCTidsz4QiE-OCIkB3iwTAouBCnn7EYZLaj3-JA8txDdBnqjbDI25rRz8H2tRvQ2ayihlDNB0SB6dUQjdw Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: e2578b0e75cb455c93cf83dfe54842ff Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-254252694 Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:35:50.824609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:35:50.826381 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:35:50.826381 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-ServerRescueNegativeTestJSON-254252694 Jul 14 14:35:50.826381 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: e2578b0e75cb455c93cf83dfe54842ff Jul 14 14:35:50.826381 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-254252694 Jul 14 14:35:50.826381 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-ServerRescueNegativeTestJSON-254252694-project Jul 14 14:35:50.826381 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:35:50.826381 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:35:50.826381 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: be6cba32a31a425e964d7222c3d6b9fc Jul 14 14:35:50.826381 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-ServerRescueNegativeTestJSON-254252694-project Jul 14 14:35:50.826381 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:35:50.826381 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Instance d79f9504-35ca-452e-8c51-8db181ea74a7 could not be found. Jul 14 14:35:50.826381 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': 'd79f9504-35ca-452e-8c51-8db181ea74a7'} Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d79f9504-35ca-452e-8c51-8db181ea74a7 could not be found. Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:50.827248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:50.828628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:50.828628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:35:50.828628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:35:50.828628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:35:50.828628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:35:50.828628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:35:50.828628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:50.828628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d79f9504-35ca-452e-8c51-8db181ea74a7 could not be found. Jul 14 14:35:50.828628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:35:50.828628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:50.828628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:35:50.828628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:50.828628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:50.828628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:50.828628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:50.828628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:50.828628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d79f9504-35ca-452e-8c51-8db181ea74a7 could not be found. Jul 14 14:35:50.828628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:35:50.829835 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a55f1dfd-0a55-4a3f-839b-89edc3ec4221 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Returning 404 to user: Instance d79f9504-35ca-452e-8c51-8db181ea74a7 could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:50.829835 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a55f1dfd-0a55-4a3f-839b-89edc3ec4221 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7" status: 404 len: 111 microversion: 2.1 time: 0.030663 Jul 14 14:35:50.829835 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 284/555] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:50 2022] GET /compute/v2.1/servers/d79f9504-35ca-452e-8c51-8db181ea74a7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:50.835267 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-41c7d095-4d31-4e26-b896-8cca65e5920c tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '.version_select at 0x7f416c4e5700>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:50.946443 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-41c7d095-4d31-4e26-b896-8cca65e5920c tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-366081478" status: 202 len: 0 microversion: 2.1 time: 0.115144 Jul 14 14:35:50.947041 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 272/556] 10.222.0.93 () {58 vars in 1217 bytes} [Thu Jul 14 14:35:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-366081478 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:35:51.544038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-6835484b-c8cb-4b68-9007-daae7e0336bb tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:51.544666 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-6835484b-c8cb-4b68-9007-daae7e0336bb tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:51.551411 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6835484b-c8cb-4b68-9007-daae7e0336bb tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:51.551861 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6835484b-c8cb-4b68-9007-daae7e0336bb tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:51.552625 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6835484b-c8cb-4b68-9007-daae7e0336bb tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:51.553048 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6835484b-c8cb-4b68-9007-daae7e0336bb tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:51.585254 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c021c3c6-b551-4d57-a72f-82936432acf8 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:51.586700 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c021c3c6-b551-4d57-a72f-82936432acf8 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:51.593084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c021c3c6-b551-4d57-a72f-82936432acf8 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:51.593528 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c021c3c6-b551-4d57-a72f-82936432acf8 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:51.594322 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c021c3c6-b551-4d57-a72f-82936432acf8 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:51.594747 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c021c3c6-b551-4d57-a72f-82936432acf8 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:51.847250 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-6835484b-c8cb-4b68-9007-daae7e0336bb tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:51.855847 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-6835484b-c8cb-4b68-9007-daae7e0336bb tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c" status: 200 len: 1514 microversion: 2.1 time: 0.315975 Jul 14 14:35:51.856414 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 285/557] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:51 2022] GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c => generated 1514 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:51.860861 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e93e568c-260e-4aa2-8bdc-b387135d719d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:51.861452 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e93e568c-260e-4aa2-8bdc-b387135d719d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:51.867826 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e93e568c-260e-4aa2-8bdc-b387135d719d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:51.868256 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e93e568c-260e-4aa2-8bdc-b387135d719d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:51.869012 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e93e568c-260e-4aa2-8bdc-b387135d719d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:51.869447 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e93e568c-260e-4aa2-8bdc-b387135d719d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:51.885054 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-c021c3c6-b551-4d57-a72f-82936432acf8 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:51.887149 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:51.893627 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c021c3c6-b551-4d57-a72f-82936432acf8 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1755 microversion: 2.1 time: 0.312977 Jul 14 14:35:51.894368 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 273/558] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:51 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1755 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:52.066217 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e93e568c-260e-4aa2-8bdc-b387135d719d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:52.074342 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e93e568c-260e-4aa2-8bdc-b387135d719d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1362 microversion: 2.1 time: 0.216945 Jul 14 14:35:52.076806 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 286/559] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:51 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:52.873260 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-64bbd1e3-0ce0-44f3-af19-6b0bbaebd00e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:52.873905 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-64bbd1e3-0ce0-44f3-af19-6b0bbaebd00e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:52.880459 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-64bbd1e3-0ce0-44f3-af19-6b0bbaebd00e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:52.880905 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-64bbd1e3-0ce0-44f3-af19-6b0bbaebd00e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:52.881658 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-64bbd1e3-0ce0-44f3-af19-6b0bbaebd00e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:52.882117 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-64bbd1e3-0ce0-44f3-af19-6b0bbaebd00e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:52.912060 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f5679a17-d4c4-4c24-b4f8-b4754ed25805 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:52.912791 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-f5679a17-d4c4-4c24-b4f8-b4754ed25805 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:52.920249 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f5679a17-d4c4-4c24-b4f8-b4754ed25805 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:52.920694 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f5679a17-d4c4-4c24-b4f8-b4754ed25805 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:52.921488 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f5679a17-d4c4-4c24-b4f8-b4754ed25805 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:52.921954 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f5679a17-d4c4-4c24-b4f8-b4754ed25805 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.069162 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-64bbd1e3-0ce0-44f3-af19-6b0bbaebd00e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:53.077554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-64bbd1e3-0ce0-44f3-af19-6b0bbaebd00e tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c" status: 200 len: 1514 microversion: 2.1 time: 0.208204 Jul 14 14:35:53.087691 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 274/560] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:52 2022] GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:53.092245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-5ac370a7-9a5a-4580-a40b-699ed570932c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:53.092969 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-5ac370a7-9a5a-4580-a40b-699ed570932c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:53.099125 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5ac370a7-9a5a-4580-a40b-699ed570932c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.099566 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5ac370a7-9a5a-4580-a40b-699ed570932c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.100328 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5ac370a7-9a5a-4580-a40b-699ed570932c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.100761 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5ac370a7-9a5a-4580-a40b-699ed570932c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.106092 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-f5679a17-d4c4-4c24-b4f8-b4754ed25805 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:53.116390 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-f5679a17-d4c4-4c24-b4f8-b4754ed25805 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1758 microversion: 2.1 time: 0.208095 Jul 14 14:35:53.116972 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 287/561] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:52 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1758 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:53.182892 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-add4a356-76c7-4eda-9889-0ee5ae661f14 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:53.183411 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-add4a356-76c7-4eda-9889-0ee5ae661f14 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:53.190417 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-add4a356-76c7-4eda-9889-0ee5ae661f14 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.191245 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-add4a356-76c7-4eda-9889-0ee5ae661f14 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.192210 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-add4a356-76c7-4eda-9889-0ee5ae661f14 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.192796 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-add4a356-76c7-4eda-9889-0ee5ae661f14 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.226985 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.objects.instance [None req-add4a356-76c7-4eda-9889-0ee5ae661f14 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lazy-loading 'flavor' on Instance uuid 833f486d-a5d2-41ff-8404-19f21892e73c {{(pid=118461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:35:53.253232 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-5ac370a7-9a5a-4580-a40b-699ed570932c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:53.260904 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-5ac370a7-9a5a-4580-a40b-699ed570932c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1362 microversion: 2.1 time: 0.172709 Jul 14 14:35:53.261455 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 275/562] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:53 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:53.704333 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-add4a356-76c7-4eda-9889-0ee5ae661f14 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "POST /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c/action" status: 202 len: 0 microversion: 2.1 time: 0.525246 Jul 14 14:35:53.704909 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 288/563] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 14 14:35:53 2022] POST /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:35:53.714189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7e20b60f-1d40-4516-b4dd-9abbf324be64 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:53.715129 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-7e20b60f-1d40-4516-b4dd-9abbf324be64 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:53.721285 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7e20b60f-1d40-4516-b4dd-9abbf324be64 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.721835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7e20b60f-1d40-4516-b4dd-9abbf324be64 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.722669 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7e20b60f-1d40-4516-b4dd-9abbf324be64 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.723322 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7e20b60f-1d40-4516-b4dd-9abbf324be64 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.861193 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7e20b60f-1d40-4516-b4dd-9abbf324be64 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:53.868765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-7e20b60f-1d40-4516-b4dd-9abbf324be64 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.158961 Jul 14 14:35:53.869418 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 276/564] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:53 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:54.096406 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-8447db07-e581-4855-9633-274c0c96adfc tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:54.097167 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-8447db07-e581-4855-9633-274c0c96adfc tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:54.103970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8447db07-e581-4855-9633-274c0c96adfc tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:54.104413 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8447db07-e581-4855-9633-274c0c96adfc tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:54.105429 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8447db07-e581-4855-9633-274c0c96adfc tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:54.105887 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8447db07-e581-4855-9633-274c0c96adfc tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:54.260131 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-8447db07-e581-4855-9633-274c0c96adfc tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:54.260131 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-8447db07-e581-4855-9633-274c0c96adfc tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c" status: 200 len: 1514 microversion: 2.1 time: 0.156750 Jul 14 14:35:54.260131 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 289/565] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:54 2022] GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:54.282929 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b9ec67f1-8bba-4753-9fda-d3332347130c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:54.283558 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b9ec67f1-8bba-4753-9fda-d3332347130c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:54.291292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b9ec67f1-8bba-4753-9fda-d3332347130c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:54.292387 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b9ec67f1-8bba-4753-9fda-d3332347130c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:54.293682 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b9ec67f1-8bba-4753-9fda-d3332347130c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:54.301130 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b9ec67f1-8bba-4753-9fda-d3332347130c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:54.306171 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-daed64a8-ecc6-4ee7-af1f-67ae6f5eb6d3 req-547ce419-9b84-4287-8f5b-04b0f8e8aa2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f04c79-b2ea-48d2-bea5-41c631a8e63c", "name": "network-vif-deleted", "tag": "de354651-c5b6-4cfd-b538-bcf04cdfa541"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:54.314810 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-daed64a8-ecc6-4ee7-af1f-67ae6f5eb6d3 req-547ce419-9b84-4287-8f5b-04b0f8e8aa2e service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:54.315175 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-daed64a8-ecc6-4ee7-af1f-67ae6f5eb6d3 req-547ce419-9b84-4287-8f5b-04b0f8e8aa2e service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:54.326520 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-daed64a8-ecc6-4ee7-af1f-67ae6f5eb6d3 req-547ce419-9b84-4287-8f5b-04b0f8e8aa2e service nova] Creating event network-vif-deleted:de354651-c5b6-4cfd-b538-bcf04cdfa541 for instance 64f04c79-b2ea-48d2-bea5-41c631a8e63c on hv-cinder-79987 Jul 14 14:35:54.331969 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-daed64a8-ecc6-4ee7-af1f-67ae6f5eb6d3 req-547ce419-9b84-4287-8f5b-04b0f8e8aa2e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029929 Jul 14 14:35:54.332694 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 290/566] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:35:54.445309 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b9ec67f1-8bba-4753-9fda-d3332347130c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:54.465322 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b9ec67f1-8bba-4753-9fda-d3332347130c tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1362 microversion: 2.1 time: 0.176706 Jul 14 14:35:54.465322 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 277/567] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:54 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:54.886915 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e8b5052a-f3a6-4450-a277-4c2f296b8781 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:54.887647 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e8b5052a-f3a6-4450-a277-4c2f296b8781 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:54.893923 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e8b5052a-f3a6-4450-a277-4c2f296b8781 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:54.894368 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e8b5052a-f3a6-4450-a277-4c2f296b8781 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:54.895127 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e8b5052a-f3a6-4450-a277-4c2f296b8781 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:54.895559 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e8b5052a-f3a6-4450-a277-4c2f296b8781 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:55.050664 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e8b5052a-f3a6-4450-a277-4c2f296b8781 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:55.059505 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e8b5052a-f3a6-4450-a277-4c2f296b8781 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.177555 Jul 14 14:35:55.060174 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 291/568] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:54 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:55.266171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-4b334e1f-4367-4751-8a93-d5a6878df265 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:55.266810 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-4b334e1f-4367-4751-8a93-d5a6878df265 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:55.273600 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4b334e1f-4367-4751-8a93-d5a6878df265 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.274071 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4b334e1f-4367-4751-8a93-d5a6878df265 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:55.274834 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4b334e1f-4367-4751-8a93-d5a6878df265 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.275265 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4b334e1f-4367-4751-8a93-d5a6878df265 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:55.314802 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4b334e1f-4367-4751-8a93-d5a6878df265 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.315469 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4b334e1f-4367-4751-8a93-d5a6878df265 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:55.316116 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-4b334e1f-4367-4751-8a93-d5a6878df265 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lazy-loading 'fault' on Instance uuid 64f04c79-b2ea-48d2-bea5-41c631a8e63c {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:35:55.362147 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-4b334e1f-4367-4751-8a93-d5a6878df265 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1336e374bb542b7a036e3c0d0af54f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceeb3ddff16645c6bd9ca8e138ed356f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:55.370896 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-4b334e1f-4367-4751-8a93-d5a6878df265 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c" status: 200 len: 1309 microversion: 2.1 time: 0.108700 Jul 14 14:35:55.373743 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 278/569] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:55 2022] GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c => generated 1309 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:55.402078 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-657ac7cd-769a-4b6d-95e7-1df76716d9c7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:55.402625 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-657ac7cd-769a-4b6d-95e7-1df76716d9c7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:55.409868 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-657ac7cd-769a-4b6d-95e7-1df76716d9c7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.410343 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-657ac7cd-769a-4b6d-95e7-1df76716d9c7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:55.411138 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-657ac7cd-769a-4b6d-95e7-1df76716d9c7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.411763 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-657ac7cd-769a-4b6d-95e7-1df76716d9c7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:55.438502 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-657ac7cd-769a-4b6d-95e7-1df76716d9c7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Going to try to terminate instance {{(pid=118461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:35:55.529739 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-1af310cc-e00f-4325-b351-569de54c94cc tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:55.530360 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-1af310cc-e00f-4325-b351-569de54c94cc tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:55.536413 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1af310cc-e00f-4325-b351-569de54c94cc tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.536851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1af310cc-e00f-4325-b351-569de54c94cc tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:55.537600 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1af310cc-e00f-4325-b351-569de54c94cc tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.538060 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1af310cc-e00f-4325-b351-569de54c94cc tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:55.673017 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-1af310cc-e00f-4325-b351-569de54c94cc tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:55.680326 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-1af310cc-e00f-4325-b351-569de54c94cc tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1362 microversion: 2.1 time: 0.214036 Jul 14 14:35:55.680894 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 279/570] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:55 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:55.747686 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-657ac7cd-769a-4b6d-95e7-1df76716d9c7 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 204 len: 0 microversion: 2.1 time: 0.348111 Jul 14 14:35:55.748285 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 292/571] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:35:55 2022] DELETE /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:35:55.756888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e98bbdba-840b-4271-8127-fabb16981b81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:55.758028 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e98bbdba-840b-4271-8127-fabb16981b81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:55.765533 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e98bbdba-840b-4271-8127-fabb16981b81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.766021 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e98bbdba-840b-4271-8127-fabb16981b81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:55.766784 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e98bbdba-840b-4271-8127-fabb16981b81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.767215 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e98bbdba-840b-4271-8127-fabb16981b81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:55.904678 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e98bbdba-840b-4271-8127-fabb16981b81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:55.912370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e98bbdba-840b-4271-8127-fabb16981b81 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1506 microversion: 2.1 time: 0.159971 Jul 14 14:35:55.912934 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 280/572] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:55 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:56.077523 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-5d582fe9-c6ba-4f95-ab14-99488fee1cde tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:56.078239 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-5d582fe9-c6ba-4f95-ab14-99488fee1cde tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:56.084430 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5d582fe9-c6ba-4f95-ab14-99488fee1cde tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:56.084872 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5d582fe9-c6ba-4f95-ab14-99488fee1cde tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:56.086281 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5d582fe9-c6ba-4f95-ab14-99488fee1cde tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:56.086710 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5d582fe9-c6ba-4f95-ab14-99488fee1cde tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:56.219765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5d582fe9-c6ba-4f95-ab14-99488fee1cde tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:56.227876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-5d582fe9-c6ba-4f95-ab14-99488fee1cde tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.154817 Jul 14 14:35:56.228439 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 293/573] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:56 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:56.392526 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ae9318a6-931a-490c-8331-28ba801e15d9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:56.393044 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ae9318a6-931a-490c-8331-28ba801e15d9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] [instance: 64f04c79-b2ea-48d2-bea5-41c631a8e63c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:56.400069 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ae9318a6-931a-490c-8331-28ba801e15d9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:56.400513 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ae9318a6-931a-490c-8331-28ba801e15d9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:56.401271 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ae9318a6-931a-490c-8331-28ba801e15d9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:56.401706 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ae9318a6-931a-490c-8331-28ba801e15d9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:56.415456 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-ae9318a6-931a-490c-8331-28ba801e15d9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] HTTP exception thrown: Instance 64f04c79-b2ea-48d2-bea5-41c631a8e63c could not be found. Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ae9318a6-931a-490c-8331-28ba801e15d9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Request method failure captured: Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c HTTP/1.1 Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0Ck9MFFjm5j1Odooc52jV3Ot0bClGwhsfFs5cR_XTozmrnxCAC7TSnbebVmRwMOjoZW_lioQNQbbUJntN5Cvfz2a0N_zv4XDKLOeftkiVunvTDll4LmTXeNfJZ8mC8WoGFoy4IPNyDXwsL_DA6zH0FUn9Dh7M_6h9HdAo9_nBxiji3A Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: ceeb3ddff16645c6bd9ca8e138ed356f Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-VolumesSnapshotTestJSON-211992955 Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:35:56.417084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:35:56.418701 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_ceeb3ddff16645c6bd9ca8e138ed356f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ceeb3ddff16645c6bd9ca8e138ed356f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/ceeb3ddff16645c6bd9ca8e138ed356f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/ceeb3ddff16645c6bd9ca8e138ed356f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:35:56.418701 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-VolumesSnapshotTestJSON-211992955 Jul 14 14:35:56.418701 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: ceeb3ddff16645c6bd9ca8e138ed356f Jul 14 14:35:56.418701 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-211992955 Jul 14 14:35:56.418701 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-VolumesSnapshotTestJSON-211992955-project Jul 14 14:35:56.418701 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:35:56.418701 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:35:56.418701 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: a1336e374bb542b7a036e3c0d0af54f3 Jul 14 14:35:56.418701 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-VolumesSnapshotTestJSON-211992955-project Jul 14 14:35:56.418701 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:35:56.418701 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 64f04c79-b2ea-48d2-bea5-41c631a8e63c could not be found. Jul 14 14:35:56.418701 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '64f04c79-b2ea-48d2-bea5-41c631a8e63c'} Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64f04c79-b2ea-48d2-bea5-41c631a8e63c could not be found. Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:56.419598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:56.421133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:56.421133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:35:56.421133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:35:56.421133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:35:56.421133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:35:56.421133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:35:56.421133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:56.421133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64f04c79-b2ea-48d2-bea5-41c631a8e63c could not be found. Jul 14 14:35:56.421133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:35:56.421133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:56.421133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:35:56.421133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:56.421133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:56.421133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:56.421133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:56.421133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:56.421133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64f04c79-b2ea-48d2-bea5-41c631a8e63c could not be found. Jul 14 14:35:56.421133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:35:56.422678 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ae9318a6-931a-490c-8331-28ba801e15d9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] Returning 404 to user: Instance 64f04c79-b2ea-48d2-bea5-41c631a8e63c could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:56.422678 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ae9318a6-931a-490c-8331-28ba801e15d9 tempest-VolumesSnapshotTestJSON-211992955 tempest-VolumesSnapshotTestJSON-211992955-project] 10.222.0.93 "GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c" status: 404 len: 111 microversion: 2.1 time: 0.029917 Jul 14 14:35:56.422678 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 281/574] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:56 2022] GET /compute/v2.1/servers/64f04c79-b2ea-48d2-bea5-41c631a8e63c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:56.697103 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-1b670726-097e-41ea-9593-559af5e79814 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:56.697709 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-1b670726-097e-41ea-9593-559af5e79814 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:56.704295 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1b670726-097e-41ea-9593-559af5e79814 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:56.704746 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1b670726-097e-41ea-9593-559af5e79814 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:56.705536 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1b670726-097e-41ea-9593-559af5e79814 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:56.706006 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1b670726-097e-41ea-9593-559af5e79814 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:56.840206 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-bd8a3b60-dbef-4b7b-b50b-6cdffc68ad2f req-2f9a91bc-e986-4423-8f21-55e9f70fa0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911572ab-0885-4187-b3f7-4a62f1848c1d", "name": "network-vif-plugged", "status": "completed", "tag": "1036eb7e-e728-484f-95a0-13ba697cc1cc"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:56.847829 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-1b670726-097e-41ea-9593-559af5e79814 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:56.853517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-bd8a3b60-dbef-4b7b-b50b-6cdffc68ad2f req-2f9a91bc-e986-4423-8f21-55e9f70fa0e0 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:56.854079 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-bd8a3b60-dbef-4b7b-b50b-6cdffc68ad2f req-2f9a91bc-e986-4423-8f21-55e9f70fa0e0 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:56.855962 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-1b670726-097e-41ea-9593-559af5e79814 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1362 microversion: 2.1 time: 0.162759 Jul 14 14:35:56.856534 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 294/575] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:56 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:56.865953 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-bd8a3b60-dbef-4b7b-b50b-6cdffc68ad2f req-2f9a91bc-e986-4423-8f21-55e9f70fa0e0 service nova] Creating event network-vif-plugged:1036eb7e-e728-484f-95a0-13ba697cc1cc for instance 911572ab-0885-4187-b3f7-4a62f1848c1d on hv-cinder-79987 Jul 14 14:35:56.870954 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-bd8a3b60-dbef-4b7b-b50b-6cdffc68ad2f req-2f9a91bc-e986-4423-8f21-55e9f70fa0e0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035652 Jul 14 14:35:56.871569 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 282/576] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:35:56.929741 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-df2e3f5a-9dd1-4d13-81b5-ef9abaaa4df6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:56.930296 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-df2e3f5a-9dd1-4d13-81b5-ef9abaaa4df6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:56.948467 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-df2e3f5a-9dd1-4d13-81b5-ef9abaaa4df6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:56.948467 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-df2e3f5a-9dd1-4d13-81b5-ef9abaaa4df6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:56.948467 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-df2e3f5a-9dd1-4d13-81b5-ef9abaaa4df6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:56.948467 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-df2e3f5a-9dd1-4d13-81b5-ef9abaaa4df6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:57.074354 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-df2e3f5a-9dd1-4d13-81b5-ef9abaaa4df6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:57.081898 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-df2e3f5a-9dd1-4d13-81b5-ef9abaaa4df6 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1506 microversion: 2.1 time: 0.156076 Jul 14 14:35:57.082786 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 295/577] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:56 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:57.245108 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-116f9ff0-7109-4a76-8d84-398c88b71be6 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:57.245820 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-116f9ff0-7109-4a76-8d84-398c88b71be6 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:57.252362 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-116f9ff0-7109-4a76-8d84-398c88b71be6 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:57.252723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-116f9ff0-7109-4a76-8d84-398c88b71be6 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:57.253477 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-116f9ff0-7109-4a76-8d84-398c88b71be6 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:57.253934 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-116f9ff0-7109-4a76-8d84-398c88b71be6 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:57.385595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-116f9ff0-7109-4a76-8d84-398c88b71be6 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:57.393219 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-116f9ff0-7109-4a76-8d84-398c88b71be6 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.152432 Jul 14 14:35:57.393832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 283/578] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:57 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:57.873301 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-8cff83ed-7ae6-44df-9818-79a34ea13b28 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:57.874032 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-8cff83ed-7ae6-44df-9818-79a34ea13b28 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:57.880490 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8cff83ed-7ae6-44df-9818-79a34ea13b28 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:57.880928 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8cff83ed-7ae6-44df-9818-79a34ea13b28 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:57.881671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8cff83ed-7ae6-44df-9818-79a34ea13b28 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:57.882134 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8cff83ed-7ae6-44df-9818-79a34ea13b28 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:58.022523 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-8cff83ed-7ae6-44df-9818-79a34ea13b28 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:58.030582 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-8cff83ed-7ae6-44df-9818-79a34ea13b28 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1362 microversion: 2.1 time: 0.161560 Jul 14 14:35:58.031179 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 296/579] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:57 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:58.098676 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-13c79890-3064-4e7b-a856-94a31c8f499d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:58.099295 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-13c79890-3064-4e7b-a856-94a31c8f499d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:58.106695 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-13c79890-3064-4e7b-a856-94a31c8f499d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:58.107133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-13c79890-3064-4e7b-a856-94a31c8f499d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:58.107885 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-13c79890-3064-4e7b-a856-94a31c8f499d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:58.108315 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-13c79890-3064-4e7b-a856-94a31c8f499d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:58.242668 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-13c79890-3064-4e7b-a856-94a31c8f499d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:58.250258 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-13c79890-3064-4e7b-a856-94a31c8f499d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1506 microversion: 2.1 time: 0.155490 Jul 14 14:35:58.251015 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 284/580] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:58 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:58.411041 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-cbb42883-11ef-4e47-9fd6-1af12716a204 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:58.411569 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-cbb42883-11ef-4e47-9fd6-1af12716a204 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:58.417641 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cbb42883-11ef-4e47-9fd6-1af12716a204 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:58.418122 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cbb42883-11ef-4e47-9fd6-1af12716a204 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:58.418874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cbb42883-11ef-4e47-9fd6-1af12716a204 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:58.419308 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cbb42883-11ef-4e47-9fd6-1af12716a204 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:58.567407 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-cbb42883-11ef-4e47-9fd6-1af12716a204 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:58.580787 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-cbb42883-11ef-4e47-9fd6-1af12716a204 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.173442 Jul 14 14:35:58.581460 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 297/581] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:58 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:58.606571 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-277f6e39-0874-4b09-a4d5-22e157cdf063 req-82b9464d-107c-4948-acdb-4349d806337b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52c67b1-7116-43ef-be38-0f7c6acc677f", "name": "network-vif-deleted", "tag": "ac66ed7d-031b-4b52-a7dd-034845cce439"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:58.614700 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-277f6e39-0874-4b09-a4d5-22e157cdf063 req-82b9464d-107c-4948-acdb-4349d806337b service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:58.615211 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-277f6e39-0874-4b09-a4d5-22e157cdf063 req-82b9464d-107c-4948-acdb-4349d806337b service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:58.626689 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-277f6e39-0874-4b09-a4d5-22e157cdf063 req-82b9464d-107c-4948-acdb-4349d806337b service nova] Creating event network-vif-deleted:ac66ed7d-031b-4b52-a7dd-034845cce439 for instance f52c67b1-7116-43ef-be38-0f7c6acc677f on hv-cinder-79987 Jul 14 14:35:58.631636 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-277f6e39-0874-4b09-a4d5-22e157cdf063 req-82b9464d-107c-4948-acdb-4349d806337b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029166 Jul 14 14:35:58.632949 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 285/582] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:59.048315 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-9a21dfa1-2c37-4596-ac19-dd9bf425eff2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:59.048929 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-9a21dfa1-2c37-4596-ac19-dd9bf425eff2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:59.055580 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9a21dfa1-2c37-4596-ac19-dd9bf425eff2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:59.056479 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9a21dfa1-2c37-4596-ac19-dd9bf425eff2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:59.059054 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9a21dfa1-2c37-4596-ac19-dd9bf425eff2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:59.059054 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9a21dfa1-2c37-4596-ac19-dd9bf425eff2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:59.205214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-9a21dfa1-2c37-4596-ac19-dd9bf425eff2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:59.213087 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-9a21dfa1-2c37-4596-ac19-dd9bf425eff2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1362 microversion: 2.1 time: 0.168861 Jul 14 14:35:59.213645 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 298/583] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:59 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:59.269113 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-53889217-12cf-40c2-835b-97501109389e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:59.269842 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-53889217-12cf-40c2-835b-97501109389e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:59.276635 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-53889217-12cf-40c2-835b-97501109389e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:59.277098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-53889217-12cf-40c2-835b-97501109389e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:59.277875 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-53889217-12cf-40c2-835b-97501109389e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:59.278312 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-53889217-12cf-40c2-835b-97501109389e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:59.309089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-53889217-12cf-40c2-835b-97501109389e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:59.309543 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-53889217-12cf-40c2-835b-97501109389e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:59.310021 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-53889217-12cf-40c2-835b-97501109389e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lazy-loading 'fault' on Instance uuid f52c67b1-7116-43ef-be38-0f7c6acc677f {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:35:59.350733 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-53889217-12cf-40c2-835b-97501109389e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:59.359563 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-53889217-12cf-40c2-835b-97501109389e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1310 microversion: 2.1 time: 0.095179 Jul 14 14:35:59.360176 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 286/584] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:59 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1310 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:59.597418 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b84e5f0e-18ef-45bf-b286-8a857c9052b8 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:59.597981 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b84e5f0e-18ef-45bf-b286-8a857c9052b8 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:59.604682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b84e5f0e-18ef-45bf-b286-8a857c9052b8 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:59.605392 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b84e5f0e-18ef-45bf-b286-8a857c9052b8 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:59.606472 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b84e5f0e-18ef-45bf-b286-8a857c9052b8 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:59.606900 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b84e5f0e-18ef-45bf-b286-8a857c9052b8 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:59.738788 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b84e5f0e-18ef-45bf-b286-8a857c9052b8 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:59.746380 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b84e5f0e-18ef-45bf-b286-8a857c9052b8 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.152987 Jul 14 14:35:59.746946 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 299/585] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:59 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:00.230765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0289cfa7-2d17-439f-891f-83a053af636a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:00.231374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0289cfa7-2d17-439f-891f-83a053af636a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:00.237512 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0289cfa7-2d17-439f-891f-83a053af636a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.237982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0289cfa7-2d17-439f-891f-83a053af636a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.238729 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0289cfa7-2d17-439f-891f-83a053af636a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.239153 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0289cfa7-2d17-439f-891f-83a053af636a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.365494 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-0289cfa7-2d17-439f-891f-83a053af636a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:00.373650 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0289cfa7-2d17-439f-891f-83a053af636a tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1362 microversion: 2.1 time: 0.147678 Jul 14 14:36:00.374393 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 287/586] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:00 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:00.377642 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ec540760-3423-489e-9e64-0300a9986a2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:00.378310 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-ec540760-3423-489e-9e64-0300a9986a2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:00.385204 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ec540760-3423-489e-9e64-0300a9986a2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.385641 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ec540760-3423-489e-9e64-0300a9986a2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.386433 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ec540760-3423-489e-9e64-0300a9986a2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.386893 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ec540760-3423-489e-9e64-0300a9986a2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.391144 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:00.419742 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ec540760-3423-489e-9e64-0300a9986a2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.420195 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ec540760-3423-489e-9e64-0300a9986a2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.420631 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.objects.instance [None req-ec540760-3423-489e-9e64-0300a9986a2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lazy-loading 'fault' on Instance uuid f52c67b1-7116-43ef-be38-0f7c6acc677f {{(pid=118461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:36:00.463702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-ec540760-3423-489e-9e64-0300a9986a2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:00.471339 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-ec540760-3423-489e-9e64-0300a9986a2d tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1310 microversion: 2.1 time: 0.098948 Jul 14 14:36:00.471910 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 300/587] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:00 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1310 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:00.763317 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e5fb1f9c-9b1b-4113-b7e7-487f4f78655b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:00.763923 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e5fb1f9c-9b1b-4113-b7e7-487f4f78655b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:00.769985 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e5fb1f9c-9b1b-4113-b7e7-487f4f78655b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.770433 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e5fb1f9c-9b1b-4113-b7e7-487f4f78655b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.771177 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e5fb1f9c-9b1b-4113-b7e7-487f4f78655b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.771612 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e5fb1f9c-9b1b-4113-b7e7-487f4f78655b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.905591 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e5fb1f9c-9b1b-4113-b7e7-487f4f78655b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:00.912308 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e5fb1f9c-9b1b-4113-b7e7-487f4f78655b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.152827 Jul 14 14:36:00.912884 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 288/588] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:00 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:01.392254 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-2187adcc-97c3-401f-bfed-4d6a7752d5de tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:01.392776 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-2187adcc-97c3-401f-bfed-4d6a7752d5de tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:01.399796 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2187adcc-97c3-401f-bfed-4d6a7752d5de tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:01.400230 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2187adcc-97c3-401f-bfed-4d6a7752d5de tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:01.401017 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2187adcc-97c3-401f-bfed-4d6a7752d5de tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:01.401441 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2187adcc-97c3-401f-bfed-4d6a7752d5de tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:01.490603 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f0e221ca-b520-42b9-b9c7-ee90d54310f4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:01.491857 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f0e221ca-b520-42b9-b9c7-ee90d54310f4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:01.498789 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f0e221ca-b520-42b9-b9c7-ee90d54310f4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:01.499228 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f0e221ca-b520-42b9-b9c7-ee90d54310f4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:01.499992 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f0e221ca-b520-42b9-b9c7-ee90d54310f4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:01.500419 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f0e221ca-b520-42b9-b9c7-ee90d54310f4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:01.533071 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f0e221ca-b520-42b9-b9c7-ee90d54310f4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:01.533524 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f0e221ca-b520-42b9-b9c7-ee90d54310f4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:01.534018 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-f0e221ca-b520-42b9-b9c7-ee90d54310f4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lazy-loading 'fault' on Instance uuid f52c67b1-7116-43ef-be38-0f7c6acc677f {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:36:01.534677 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-2187adcc-97c3-401f-bfed-4d6a7752d5de tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:01.542149 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-2187adcc-97c3-401f-bfed-4d6a7752d5de tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1362 microversion: 2.1 time: 0.153899 Jul 14 14:36:01.542714 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 301/589] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:01 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:01.574230 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f0e221ca-b520-42b9-b9c7-ee90d54310f4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:01.581718 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f0e221ca-b520-42b9-b9c7-ee90d54310f4 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1310 microversion: 2.1 time: 0.096923 Jul 14 14:36:01.582501 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 289/590] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:01 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1310 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:01.930364 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a57323ab-a4b3-4411-8486-9e9c8a016e74 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:01.930971 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a57323ab-a4b3-4411-8486-9e9c8a016e74 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:01.937038 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a57323ab-a4b3-4411-8486-9e9c8a016e74 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:01.937539 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a57323ab-a4b3-4411-8486-9e9c8a016e74 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:01.938326 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a57323ab-a4b3-4411-8486-9e9c8a016e74 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:01.938759 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a57323ab-a4b3-4411-8486-9e9c8a016e74 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:02.080883 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a57323ab-a4b3-4411-8486-9e9c8a016e74 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:02.087509 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a57323ab-a4b3-4411-8486-9e9c8a016e74 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.161781 Jul 14 14:36:02.088079 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 302/591] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:01 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:02.559904 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-669d89d4-eb9f-4099-ba8b-0b418f9952d3 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:02.560545 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-669d89d4-eb9f-4099-ba8b-0b418f9952d3 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:02.567275 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-669d89d4-eb9f-4099-ba8b-0b418f9952d3 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:02.567720 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-669d89d4-eb9f-4099-ba8b-0b418f9952d3 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:02.569734 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-669d89d4-eb9f-4099-ba8b-0b418f9952d3 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:02.569734 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-669d89d4-eb9f-4099-ba8b-0b418f9952d3 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:02.584308 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=100 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:02.598415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d30a6e7b-dc29-4cb2-bcda-6fa9bef3db7e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:02.599143 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d30a6e7b-dc29-4cb2-bcda-6fa9bef3db7e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:02.606554 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d30a6e7b-dc29-4cb2-bcda-6fa9bef3db7e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:02.607066 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d30a6e7b-dc29-4cb2-bcda-6fa9bef3db7e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:02.607889 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d30a6e7b-dc29-4cb2-bcda-6fa9bef3db7e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:02.608385 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d30a6e7b-dc29-4cb2-bcda-6fa9bef3db7e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:02.642498 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d30a6e7b-dc29-4cb2-bcda-6fa9bef3db7e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:02.642945 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d30a6e7b-dc29-4cb2-bcda-6fa9bef3db7e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:02.643388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.objects.instance [None req-d30a6e7b-dc29-4cb2-bcda-6fa9bef3db7e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lazy-loading 'fault' on Instance uuid f52c67b1-7116-43ef-be38-0f7c6acc677f {{(pid=118461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:36:02.697118 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d30a6e7b-dc29-4cb2-bcda-6fa9bef3db7e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:02.703976 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d30a6e7b-dc29-4cb2-bcda-6fa9bef3db7e tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 200 len: 1310 microversion: 2.1 time: 0.109352 Jul 14 14:36:02.704766 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 303/592] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:02 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 1310 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:02.726798 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-669d89d4-eb9f-4099-ba8b-0b418f9952d3 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:02.734884 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-669d89d4-eb9f-4099-ba8b-0b418f9952d3 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1548 microversion: 2.1 time: 0.178862 Jul 14 14:36:02.735452 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 290/593] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:02 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1548 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:02.754516 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-94d120ef-22c6-4440-a6e2-a42bf5b50804 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:02.755061 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-94d120ef-22c6-4440-a6e2-a42bf5b50804 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:02.762097 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-94d120ef-22c6-4440-a6e2-a42bf5b50804 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:02.762683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-94d120ef-22c6-4440-a6e2-a42bf5b50804 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:02.763531 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-94d120ef-22c6-4440-a6e2-a42bf5b50804 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:02.763957 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-94d120ef-22c6-4440-a6e2-a42bf5b50804 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:02.845380 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-94d120ef-22c6-4440-a6e2-a42bf5b50804 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094042 Jul 14 14:36:02.845380 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 304/594] 10.222.0.93 () {58 vars in 1274 bytes} [Thu Jul 14 14:36:02 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:03.106069 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-db4fc0a2-2156-4696-86fc-ee882e568191 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:03.106698 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-db4fc0a2-2156-4696-86fc-ee882e568191 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:03.112734 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-db4fc0a2-2156-4696-86fc-ee882e568191 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:03.113171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-db4fc0a2-2156-4696-86fc-ee882e568191 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:03.113952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-db4fc0a2-2156-4696-86fc-ee882e568191 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:03.114384 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-db4fc0a2-2156-4696-86fc-ee882e568191 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:03.328131 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-db4fc0a2-2156-4696-86fc-ee882e568191 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:03.336203 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-db4fc0a2-2156-4696-86fc-ee882e568191 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.234648 Jul 14 14:36:03.336773 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 291/595] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:03 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:03.721585 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f6eb9248-5574-4c4a-8ac6-e30cc63d17d2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:03.722391 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-f6eb9248-5574-4c4a-8ac6-e30cc63d17d2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: f52c67b1-7116-43ef-be38-0f7c6acc677f] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:03.729550 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f6eb9248-5574-4c4a-8ac6-e30cc63d17d2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:03.730290 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f6eb9248-5574-4c4a-8ac6-e30cc63d17d2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:03.731058 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f6eb9248-5574-4c4a-8ac6-e30cc63d17d2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:03.731685 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f6eb9248-5574-4c4a-8ac6-e30cc63d17d2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:03.745968 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-f6eb9248-5574-4c4a-8ac6-e30cc63d17d2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] HTTP exception thrown: Instance f52c67b1-7116-43ef-be38-0f7c6acc677f could not be found. Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f6eb9248-5574-4c4a-8ac6-e30cc63d17d2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Request method failure captured: Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f HTTP/1.1 Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0Cib88DRNxeurZ4Wu63E6s9T4DzmysupyK-6SeWi0wmSzq8BtaTmQliX_wFDfdLOwcOIILWgDDf01bHrioVSVYNSAGBd7xCTidsz4QiE-OCIkB3iwTAouBCnn7EYZLaj3-JA8txDdBnqjbDI25rRz8H2tRvQ2ayihlDNB0SB6dUQjdw Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: e2578b0e75cb455c93cf83dfe54842ff Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-254252694 Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:36:03.748298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:36:03.750112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:36:03.750112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-ServerRescueNegativeTestJSON-254252694 Jul 14 14:36:03.750112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: e2578b0e75cb455c93cf83dfe54842ff Jul 14 14:36:03.750112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-254252694 Jul 14 14:36:03.750112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-ServerRescueNegativeTestJSON-254252694-project Jul 14 14:36:03.750112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:36:03.750112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:36:03.750112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: be6cba32a31a425e964d7222c3d6b9fc Jul 14 14:36:03.750112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-ServerRescueNegativeTestJSON-254252694-project Jul 14 14:36:03.750112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:36:03.750112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Instance f52c67b1-7116-43ef-be38-0f7c6acc677f could not be found. Jul 14 14:36:03.750112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': 'f52c67b1-7116-43ef-be38-0f7c6acc677f'} Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f52c67b1-7116-43ef-be38-0f7c6acc677f could not be found. Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:03.751133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:03.753081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:03.753081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:36:03.753081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:36:03.753081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:36:03.753081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:36:03.753081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:36:03.753081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:36:03.753081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f52c67b1-7116-43ef-be38-0f7c6acc677f could not be found. Jul 14 14:36:03.753081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:36:03.753081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:03.753081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:36:03.753081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:03.753081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:03.753081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:03.753081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:03.753081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:03.753081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f52c67b1-7116-43ef-be38-0f7c6acc677f could not be found. Jul 14 14:36:03.753081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:36:03.754554 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f6eb9248-5574-4c4a-8ac6-e30cc63d17d2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Returning 404 to user: Instance f52c67b1-7116-43ef-be38-0f7c6acc677f could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:03.754554 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-f6eb9248-5574-4c4a-8ac6-e30cc63d17d2 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f" status: 404 len: 111 microversion: 2.1 time: 0.032174 Jul 14 14:36:03.754554 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 305/596] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:03 2022] GET /compute/v2.1/servers/f52c67b1-7116-43ef-be38-0f7c6acc677f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:36:03.758690 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-10873b92-5fef-4598-9179-680b22730cbc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:03.759244 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-10873b92-5fef-4598-9179-680b22730cbc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:03.765848 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-10873b92-5fef-4598-9179-680b22730cbc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:03.766374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-10873b92-5fef-4598-9179-680b22730cbc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:03.767206 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-10873b92-5fef-4598-9179-680b22730cbc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:03.767710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-10873b92-5fef-4598-9179-680b22730cbc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:03.795728 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-10873b92-5fef-4598-9179-680b22730cbc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Going to try to terminate instance {{(pid=118462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:36:04.017176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-5f4a492e-1b86-49d0-bdd1-01a1c0ff71cf req-3c870a21-34de-4347-962a-e8868a440ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911572ab-0885-4187-b3f7-4a62f1848c1d", "tag": "1036eb7e-e728-484f-95a0-13ba697cc1cc"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:04.026875 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-5f4a492e-1b86-49d0-bdd1-01a1c0ff71cf req-3c870a21-34de-4347-962a-e8868a440ac4 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:04.027583 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-5f4a492e-1b86-49d0-bdd1-01a1c0ff71cf req-3c870a21-34de-4347-962a-e8868a440ac4 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:04.041441 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-5f4a492e-1b86-49d0-bdd1-01a1c0ff71cf req-3c870a21-34de-4347-962a-e8868a440ac4 service nova] Creating event network-changed:1036eb7e-e728-484f-95a0-13ba697cc1cc for instance 911572ab-0885-4187-b3f7-4a62f1848c1d on hv-cinder-79987 Jul 14 14:36:04.047074 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-5f4a492e-1b86-49d0-bdd1-01a1c0ff71cf req-3c870a21-34de-4347-962a-e8868a440ac4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033639 Jul 14 14:36:04.047878 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 306/597] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:36:04.152382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-10873b92-5fef-4598-9179-680b22730cbc tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "DELETE /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 204 len: 0 microversion: 2.1 time: 0.397732 Jul 14 14:36:04.153233 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 292/598] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:36:03 2022] DELETE /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:36:04.161866 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c9e06d34-7469-43e2-89c6-80cfcb71c5ff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:04.162815 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c9e06d34-7469-43e2-89c6-80cfcb71c5ff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:04.169505 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c9e06d34-7469-43e2-89c6-80cfcb71c5ff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:04.169984 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c9e06d34-7469-43e2-89c6-80cfcb71c5ff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:04.170960 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c9e06d34-7469-43e2-89c6-80cfcb71c5ff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:04.171682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c9e06d34-7469-43e2-89c6-80cfcb71c5ff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:04.313424 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c9e06d34-7469-43e2-89c6-80cfcb71c5ff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:04.321402 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c9e06d34-7469-43e2-89c6-80cfcb71c5ff tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1521 microversion: 2.1 time: 0.163674 Jul 14 14:36:04.322018 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 307/599] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:04 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:04.353397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f427825a-c13b-43e9-a279-d18998d69870 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:04.354128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f427825a-c13b-43e9-a279-d18998d69870 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:04.361323 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f427825a-c13b-43e9-a279-d18998d69870 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:04.361788 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f427825a-c13b-43e9-a279-d18998d69870 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:04.362584 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f427825a-c13b-43e9-a279-d18998d69870 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:04.363013 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f427825a-c13b-43e9-a279-d18998d69870 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:04.514063 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f427825a-c13b-43e9-a279-d18998d69870 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:04.527882 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f427825a-c13b-43e9-a279-d18998d69870 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.179064 Jul 14 14:36:04.528476 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 293/600] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:04 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:05.337916 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-9472e8f1-1095-460c-b8b3-166bd510f13a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:05.338531 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-9472e8f1-1095-460c-b8b3-166bd510f13a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:05.345344 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9472e8f1-1095-460c-b8b3-166bd510f13a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:05.346084 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9472e8f1-1095-460c-b8b3-166bd510f13a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:05.347045 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9472e8f1-1095-460c-b8b3-166bd510f13a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:05.347479 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9472e8f1-1095-460c-b8b3-166bd510f13a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:05.479194 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-9472e8f1-1095-460c-b8b3-166bd510f13a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:05.487398 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-9472e8f1-1095-460c-b8b3-166bd510f13a tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1521 microversion: 2.1 time: 0.153452 Jul 14 14:36:05.487973 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 308/601] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:05 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:05.545525 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c2c25412-bb55-473f-957e-36cc1a2ae650 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:05.546532 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c2c25412-bb55-473f-957e-36cc1a2ae650 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:05.553288 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c2c25412-bb55-473f-957e-36cc1a2ae650 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:05.553731 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c2c25412-bb55-473f-957e-36cc1a2ae650 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:05.554517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c2c25412-bb55-473f-957e-36cc1a2ae650 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:05.554954 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c2c25412-bb55-473f-957e-36cc1a2ae650 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:05.683767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-c2c25412-bb55-473f-957e-36cc1a2ae650 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:05.691405 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c2c25412-bb55-473f-957e-36cc1a2ae650 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.150316 Jul 14 14:36:05.696688 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 294/602] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:05 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:06.504358 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-6e5791f5-9318-412d-a70a-29c32b0854ea tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:06.504960 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-6e5791f5-9318-412d-a70a-29c32b0854ea tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:06.511368 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6e5791f5-9318-412d-a70a-29c32b0854ea tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:06.511808 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6e5791f5-9318-412d-a70a-29c32b0854ea tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:06.512557 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6e5791f5-9318-412d-a70a-29c32b0854ea tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:06.512989 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6e5791f5-9318-412d-a70a-29c32b0854ea tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:06.708960 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-32c0a288-ca46-421b-9cd7-ba7bed422980 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:06.710870 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-32c0a288-ca46-421b-9cd7-ba7bed422980 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:06.718087 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-32c0a288-ca46-421b-9cd7-ba7bed422980 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:06.724978 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-32c0a288-ca46-421b-9cd7-ba7bed422980 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:06.724978 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-32c0a288-ca46-421b-9cd7-ba7bed422980 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:06.724978 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-32c0a288-ca46-421b-9cd7-ba7bed422980 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:06.915618 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-6e5791f5-9318-412d-a70a-29c32b0854ea tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:06.923042 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-6e5791f5-9318-412d-a70a-29c32b0854ea tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1521 microversion: 2.1 time: 0.422493 Jul 14 14:36:06.923618 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 309/603] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:06 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:06.932580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-32c0a288-ca46-421b-9cd7-ba7bed422980 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:06.940220 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-32c0a288-ca46-421b-9cd7-ba7bed422980 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.235442 Jul 14 14:36:06.940773 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 295/604] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:06 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:07.940504 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-7effc7a3-7316-43a5-8d37-c0e2111762ac tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:07.941118 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-7effc7a3-7316-43a5-8d37-c0e2111762ac tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:07.947688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7effc7a3-7316-43a5-8d37-c0e2111762ac tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:07.948138 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7effc7a3-7316-43a5-8d37-c0e2111762ac tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:07.948913 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7effc7a3-7316-43a5-8d37-c0e2111762ac tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:07.949344 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7effc7a3-7316-43a5-8d37-c0e2111762ac tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:07.960924 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-bd254e49-5bb1-4e0f-8d82-478046a99d45 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:07.961959 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-bd254e49-5bb1-4e0f-8d82-478046a99d45 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:07.974282 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bd254e49-5bb1-4e0f-8d82-478046a99d45 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:07.985219 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bd254e49-5bb1-4e0f-8d82-478046a99d45 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:07.985219 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bd254e49-5bb1-4e0f-8d82-478046a99d45 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:07.985219 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bd254e49-5bb1-4e0f-8d82-478046a99d45 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:08.175300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7effc7a3-7316-43a5-8d37-c0e2111762ac tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:08.183589 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-bd254e49-5bb1-4e0f-8d82-478046a99d45 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:08.186658 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-7effc7a3-7316-43a5-8d37-c0e2111762ac tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1521 microversion: 2.1 time: 0.250009 Jul 14 14:36:08.187709 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 310/605] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:07 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:08.199247 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-bd254e49-5bb1-4e0f-8d82-478046a99d45 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.243455 Jul 14 14:36:08.199869 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 296/606] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:07 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:08.487786 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-a893196f-5ac3-49ac-8dbf-3795e33fd637 req-93407ba1-ce92-475b-803d-1cb98dca75d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af404add-060a-4a34-ba63-b1df4171f2f2", "name": "network-vif-deleted", "tag": "0e4102af-1b96-490a-9640-00a73098d3cf"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:08.496411 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-a893196f-5ac3-49ac-8dbf-3795e33fd637 req-93407ba1-ce92-475b-803d-1cb98dca75d5 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:08.496972 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-a893196f-5ac3-49ac-8dbf-3795e33fd637 req-93407ba1-ce92-475b-803d-1cb98dca75d5 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:08.508781 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-a893196f-5ac3-49ac-8dbf-3795e33fd637 req-93407ba1-ce92-475b-803d-1cb98dca75d5 service nova] Creating event network-vif-deleted:0e4102af-1b96-490a-9640-00a73098d3cf for instance af404add-060a-4a34-ba63-b1df4171f2f2 on hv-cinder-79987 Jul 14 14:36:08.513845 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-a893196f-5ac3-49ac-8dbf-3795e33fd637 req-93407ba1-ce92-475b-803d-1cb98dca75d5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029826 Jul 14 14:36:08.514438 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 311/607] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:09.204207 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-06323236-add3-479d-9421-8611e8769d3f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:09.204814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-06323236-add3-479d-9421-8611e8769d3f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:09.211946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-06323236-add3-479d-9421-8611e8769d3f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:09.212394 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-06323236-add3-479d-9421-8611e8769d3f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:09.213170 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-06323236-add3-479d-9421-8611e8769d3f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:09.213606 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-06323236-add3-479d-9421-8611e8769d3f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:09.217715 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-05f0a283-32f1-469e-a53d-7193a515b91a tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:09.218431 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-05f0a283-32f1-469e-a53d-7193a515b91a tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:09.224722 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-05f0a283-32f1-469e-a53d-7193a515b91a tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:09.225170 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-05f0a283-32f1-469e-a53d-7193a515b91a tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:09.226571 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-05f0a283-32f1-469e-a53d-7193a515b91a tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:09.227008 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-05f0a283-32f1-469e-a53d-7193a515b91a tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:09.244336 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:09.247932 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-06323236-add3-479d-9421-8611e8769d3f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:09.248367 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-06323236-add3-479d-9421-8611e8769d3f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:09.248803 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-06323236-add3-479d-9421-8611e8769d3f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lazy-loading 'fault' on Instance uuid af404add-060a-4a34-ba63-b1df4171f2f2 {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:36:09.317439 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-06323236-add3-479d-9421-8611e8769d3f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:09.325841 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-06323236-add3-479d-9421-8611e8769d3f tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1311 microversion: 2.1 time: 0.125412 Jul 14 14:36:09.326525 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 297/608] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:09 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1311 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:09.391825 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-05f0a283-32f1-469e-a53d-7193a515b91a tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:09.400046 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-05f0a283-32f1-469e-a53d-7193a515b91a tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.186925 Jul 14 14:36:09.400618 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 312/609] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:09 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:10.343579 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-638100ca-1afa-4f3f-80f3-e565968f1534 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:10.344213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-638100ca-1afa-4f3f-80f3-e565968f1534 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:10.352031 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-638100ca-1afa-4f3f-80f3-e565968f1534 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:10.352470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-638100ca-1afa-4f3f-80f3-e565968f1534 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:10.353224 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-638100ca-1afa-4f3f-80f3-e565968f1534 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:10.353649 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-638100ca-1afa-4f3f-80f3-e565968f1534 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:10.388570 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-638100ca-1afa-4f3f-80f3-e565968f1534 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:10.389025 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-638100ca-1afa-4f3f-80f3-e565968f1534 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:10.389444 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-638100ca-1afa-4f3f-80f3-e565968f1534 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lazy-loading 'fault' on Instance uuid af404add-060a-4a34-ba63-b1df4171f2f2 {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:36:10.417083 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-216c4bad-8cf1-45d2-94e0-e7db84b69a66 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:10.417711 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-216c4bad-8cf1-45d2-94e0-e7db84b69a66 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:10.424570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-216c4bad-8cf1-45d2-94e0-e7db84b69a66 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:10.425014 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-216c4bad-8cf1-45d2-94e0-e7db84b69a66 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:10.425797 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-216c4bad-8cf1-45d2-94e0-e7db84b69a66 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:10.426219 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-216c4bad-8cf1-45d2-94e0-e7db84b69a66 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:10.430543 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-638100ca-1afa-4f3f-80f3-e565968f1534 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6cba32a31a425e964d7222c3d6b9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2578b0e75cb455c93cf83dfe54842ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:10.441383 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-638100ca-1afa-4f3f-80f3-e565968f1534 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 200 len: 1311 microversion: 2.1 time: 0.101609 Jul 14 14:36:10.441983 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 298/610] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:10 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:10.571716 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-216c4bad-8cf1-45d2-94e0-e7db84b69a66 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:10.583195 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-216c4bad-8cf1-45d2-94e0-e7db84b69a66 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.170327 Jul 14 14:36:10.584055 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 313/611] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:10 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:11.461271 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-bcb62c72-c984-41ca-90cf-ca32e0ae73a0 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:11.461947 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-bcb62c72-c984-41ca-90cf-ca32e0ae73a0 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] [instance: af404add-060a-4a34-ba63-b1df4171f2f2] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:11.468628 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bcb62c72-c984-41ca-90cf-ca32e0ae73a0 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:11.469109 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bcb62c72-c984-41ca-90cf-ca32e0ae73a0 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:11.469905 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bcb62c72-c984-41ca-90cf-ca32e0ae73a0 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:11.470362 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bcb62c72-c984-41ca-90cf-ca32e0ae73a0 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:11.484069 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-bcb62c72-c984-41ca-90cf-ca32e0ae73a0 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] HTTP exception thrown: Instance af404add-060a-4a34-ba63-b1df4171f2f2 could not be found. Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-bcb62c72-c984-41ca-90cf-ca32e0ae73a0 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Request method failure captured: Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 HTTP/1.1 Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0Cib88DRNxeurZ4Wu63E6s9T4DzmysupyK-6SeWi0wmSzq8BtaTmQliX_wFDfdLOwcOIILWgDDf01bHrioVSVYNSAGBd7xCTidsz4QiE-OCIkB3iwTAouBCnn7EYZLaj3-JA8txDdBnqjbDI25rRz8H2tRvQ2ayihlDNB0SB6dUQjdw Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: e2578b0e75cb455c93cf83dfe54842ff Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-254252694 Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:36:11.485634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:36:11.487128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/e2578b0e75cb455c93cf83dfe54842ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:36:11.487128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-ServerRescueNegativeTestJSON-254252694 Jul 14 14:36:11.487128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: e2578b0e75cb455c93cf83dfe54842ff Jul 14 14:36:11.487128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-254252694 Jul 14 14:36:11.487128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-ServerRescueNegativeTestJSON-254252694-project Jul 14 14:36:11.487128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:36:11.487128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:36:11.487128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: be6cba32a31a425e964d7222c3d6b9fc Jul 14 14:36:11.487128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-ServerRescueNegativeTestJSON-254252694-project Jul 14 14:36:11.487128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:36:11.487128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance af404add-060a-4a34-ba63-b1df4171f2f2 could not be found. Jul 14 14:36:11.487128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': 'af404add-060a-4a34-ba63-b1df4171f2f2'} Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af404add-060a-4a34-ba63-b1df4171f2f2 could not be found. Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:11.487866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:11.489388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:11.489388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:36:11.489388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:36:11.489388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:36:11.489388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:36:11.489388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:36:11.489388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:36:11.489388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af404add-060a-4a34-ba63-b1df4171f2f2 could not be found. Jul 14 14:36:11.489388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:36:11.489388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:11.489388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:36:11.489388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:11.489388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:11.489388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:11.489388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:11.489388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:11.489388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af404add-060a-4a34-ba63-b1df4171f2f2 could not be found. Jul 14 14:36:11.489388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:36:11.490976 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-bcb62c72-c984-41ca-90cf-ca32e0ae73a0 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] Returning 404 to user: Instance af404add-060a-4a34-ba63-b1df4171f2f2 could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:11.490976 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-bcb62c72-c984-41ca-90cf-ca32e0ae73a0 tempest-ServerRescueNegativeTestJSON-254252694 tempest-ServerRescueNegativeTestJSON-254252694-project] 10.222.0.93 "GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2" status: 404 len: 111 microversion: 2.1 time: 0.029909 Jul 14 14:36:11.490976 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 299/612] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:11 2022] GET /compute/v2.1/servers/af404add-060a-4a34-ba63-b1df4171f2f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:36:11.605273 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-29d9fff2-b916-4629-8926-b5c38677172c tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:11.606281 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-29d9fff2-b916-4629-8926-b5c38677172c tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:11.612494 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-29d9fff2-b916-4629-8926-b5c38677172c tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:11.612935 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-29d9fff2-b916-4629-8926-b5c38677172c tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:11.613696 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-29d9fff2-b916-4629-8926-b5c38677172c tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:11.614153 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-29d9fff2-b916-4629-8926-b5c38677172c tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:11.858281 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-29d9fff2-b916-4629-8926-b5c38677172c tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:11.865682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-29d9fff2-b916-4629-8926-b5c38677172c tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.264546 Jul 14 14:36:11.866888 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 314/613] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:11 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:12.885467 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-9ee9e7d7-d872-4b10-8ab8-42472e52f325 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:12.886906 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-9ee9e7d7-d872-4b10-8ab8-42472e52f325 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:12.895195 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9ee9e7d7-d872-4b10-8ab8-42472e52f325 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:12.895640 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9ee9e7d7-d872-4b10-8ab8-42472e52f325 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:12.896402 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9ee9e7d7-d872-4b10-8ab8-42472e52f325 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:12.896830 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9ee9e7d7-d872-4b10-8ab8-42472e52f325 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:13.355438 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-9ee9e7d7-d872-4b10-8ab8-42472e52f325 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:13.363847 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-9ee9e7d7-d872-4b10-8ab8-42472e52f325 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.484209 Jul 14 14:36:13.364431 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 300/614] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:12 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:14.384782 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-aa816b11-e4ea-4025-870f-f78fffbfb7fe tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:14.385365 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-aa816b11-e4ea-4025-870f-f78fffbfb7fe tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:14.391477 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-aa816b11-e4ea-4025-870f-f78fffbfb7fe tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:14.391921 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-aa816b11-e4ea-4025-870f-f78fffbfb7fe tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:14.392667 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-aa816b11-e4ea-4025-870f-f78fffbfb7fe tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:14.393116 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-aa816b11-e4ea-4025-870f-f78fffbfb7fe tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:14.599091 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-aa816b11-e4ea-4025-870f-f78fffbfb7fe tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:14.608051 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-aa816b11-e4ea-4025-870f-f78fffbfb7fe tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.227720 Jul 14 14:36:14.608631 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 315/615] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:14 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:15.625396 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-275b32d1-eb53-42a5-9ed4-9994df4f4128 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:15.626294 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-275b32d1-eb53-42a5-9ed4-9994df4f4128 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:15.639443 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-275b32d1-eb53-42a5-9ed4-9994df4f4128 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:15.640269 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-275b32d1-eb53-42a5-9ed4-9994df4f4128 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:15.641458 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-275b32d1-eb53-42a5-9ed4-9994df4f4128 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:15.642131 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-275b32d1-eb53-42a5-9ed4-9994df4f4128 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:15.807607 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-275b32d1-eb53-42a5-9ed4-9994df4f4128 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:15.815739 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-275b32d1-eb53-42a5-9ed4-9994df4f4128 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1567 microversion: 2.1 time: 0.194432 Jul 14 14:36:15.816304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 301/616] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:15 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:15.841063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-2654eb6d-2faf-4593-b18a-0482ce7528b7 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:15.841662 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-2654eb6d-2faf-4593-b18a-0482ce7528b7 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:15.844919 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:15.850506 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2654eb6d-2faf-4593-b18a-0482ce7528b7 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:15.850962 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2654eb6d-2faf-4593-b18a-0482ce7528b7 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:15.851749 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2654eb6d-2faf-4593-b18a-0482ce7528b7 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:15.852187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2654eb6d-2faf-4593-b18a-0482ce7528b7 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.154725 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-2654eb6d-2faf-4593-b18a-0482ce7528b7 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "POST /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c/action" status: 202 len: 0 microversion: 2.1 time: 0.317632 Jul 14 14:36:16.155735 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 316/617] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 14 14:36:15 2022] POST /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:36:16.167074 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-211da517-09e7-4127-8a4f-a12662076c08 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:16.167074 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-211da517-09e7-4127-8a4f-a12662076c08 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:16.171912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-211da517-09e7-4127-8a4f-a12662076c08 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.172365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-211da517-09e7-4127-8a4f-a12662076c08 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.173161 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-211da517-09e7-4127-8a4f-a12662076c08 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.173596 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-211da517-09e7-4127-8a4f-a12662076c08 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.321295 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-211da517-09e7-4127-8a4f-a12662076c08 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:16.330567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-211da517-09e7-4127-8a4f-a12662076c08 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1515 microversion: 2.1 time: 0.169994 Jul 14 14:36:16.341414 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 302/618] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:16 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:16.766720 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-18d0ca8c-3b7c-4388-b360-edfa47d7e25d req-9b45a6cf-1771-4a46-a3c7-c060302397be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833f486d-a5d2-41ff-8404-19f21892e73c", "name": "network-vif-unplugged", "status": "completed", "tag": "7f554063-5f76-4260-95f2-f9417cf2981a"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:16.775906 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-18d0ca8c-3b7c-4388-b360-edfa47d7e25d req-9b45a6cf-1771-4a46-a3c7-c060302397be service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.776333 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-18d0ca8c-3b7c-4388-b360-edfa47d7e25d req-9b45a6cf-1771-4a46-a3c7-c060302397be service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.787754 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.compute.server_external_events [req-18d0ca8c-3b7c-4388-b360-edfa47d7e25d req-9b45a6cf-1771-4a46-a3c7-c060302397be service nova] Unable to find a host for instance 833f486d-a5d2-41ff-8404-19f21892e73c. Dropping event network-vif-unplugged {{(pid=118461) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 14:36:16.789192 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-18d0ca8c-3b7c-4388-b360-edfa47d7e25d req-9b45a6cf-1771-4a46-a3c7-c060302397be service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026831 Jul 14 14:36:16.789786 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 317/619] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 14 14:36:17.347663 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e35b74ca-7d5d-47ed-8b99-4b78284e550f tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:17.348153 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e35b74ca-7d5d-47ed-8b99-4b78284e550f tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:17.355192 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e35b74ca-7d5d-47ed-8b99-4b78284e550f tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:17.356262 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e35b74ca-7d5d-47ed-8b99-4b78284e550f tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:17.356700 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e35b74ca-7d5d-47ed-8b99-4b78284e550f tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:17.357303 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e35b74ca-7d5d-47ed-8b99-4b78284e550f tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:17.495707 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e35b74ca-7d5d-47ed-8b99-4b78284e550f tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:17.503188 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e35b74ca-7d5d-47ed-8b99-4b78284e550f tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1515 microversion: 2.1 time: 0.160224 Jul 14 14:36:17.503781 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 303/620] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:17 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:18.520476 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-5f2d1cbc-2562-434a-a929-a2dd6aa55ba3 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:18.521085 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-5f2d1cbc-2562-434a-a929-a2dd6aa55ba3 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:18.528312 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5f2d1cbc-2562-434a-a929-a2dd6aa55ba3 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:18.532872 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5f2d1cbc-2562-434a-a929-a2dd6aa55ba3 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:18.532872 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5f2d1cbc-2562-434a-a929-a2dd6aa55ba3 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:18.532872 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5f2d1cbc-2562-434a-a929-a2dd6aa55ba3 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:18.535007 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:18.664918 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5f2d1cbc-2562-434a-a929-a2dd6aa55ba3 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:18.672653 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-5f2d1cbc-2562-434a-a929-a2dd6aa55ba3 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1517 microversion: 2.1 time: 0.156004 Jul 14 14:36:18.673157 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 318/621] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:18 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:19.694392 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-701b0fba-8f04-4cae-b0f9-c222848eaa94 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:19.696578 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-701b0fba-8f04-4cae-b0f9-c222848eaa94 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:19.704412 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-701b0fba-8f04-4cae-b0f9-c222848eaa94 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:19.705129 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-701b0fba-8f04-4cae-b0f9-c222848eaa94 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:19.705959 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-701b0fba-8f04-4cae-b0f9-c222848eaa94 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:19.706586 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-701b0fba-8f04-4cae-b0f9-c222848eaa94 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:19.849245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-701b0fba-8f04-4cae-b0f9-c222848eaa94 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:19.857673 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-701b0fba-8f04-4cae-b0f9-c222848eaa94 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1573 microversion: 2.1 time: 0.168457 Jul 14 14:36:19.858260 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 304/622] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:19 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1573 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:20.875231 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0bd1eb15-a6af-42bd-b8f2-5fd9f3ce0644 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:20.875975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-0bd1eb15-a6af-42bd-b8f2-5fd9f3ce0644 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:20.884803 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0bd1eb15-a6af-42bd-b8f2-5fd9f3ce0644 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:20.885265 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0bd1eb15-a6af-42bd-b8f2-5fd9f3ce0644 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:20.886032 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0bd1eb15-a6af-42bd-b8f2-5fd9f3ce0644 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:20.886461 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0bd1eb15-a6af-42bd-b8f2-5fd9f3ce0644 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:21.058535 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-0bd1eb15-a6af-42bd-b8f2-5fd9f3ce0644 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:21.066687 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-0bd1eb15-a6af-42bd-b8f2-5fd9f3ce0644 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1573 microversion: 2.1 time: 0.195697 Jul 14 14:36:21.067520 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 319/623] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:20 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1573 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:22.084611 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-500d766a-6392-4491-a4b6-5641b7432bcc tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:22.085746 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-500d766a-6392-4491-a4b6-5641b7432bcc tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:22.092582 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-500d766a-6392-4491-a4b6-5641b7432bcc tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:22.093041 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-500d766a-6392-4491-a4b6-5641b7432bcc tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:22.093843 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-500d766a-6392-4491-a4b6-5641b7432bcc tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:22.094313 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-500d766a-6392-4491-a4b6-5641b7432bcc tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:22.111238 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:22.333160 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-500d766a-6392-4491-a4b6-5641b7432bcc tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:22.341936 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-500d766a-6392-4491-a4b6-5641b7432bcc tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1573 microversion: 2.1 time: 0.261272 Jul 14 14:36:22.342518 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 305/624] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:22 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1573 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:23.359648 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-2de9e0aa-1240-4555-b400-01068ee21c25 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:23.363500 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-2de9e0aa-1240-4555-b400-01068ee21c25 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:23.368158 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2de9e0aa-1240-4555-b400-01068ee21c25 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:23.368555 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2de9e0aa-1240-4555-b400-01068ee21c25 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:23.369514 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2de9e0aa-1240-4555-b400-01068ee21c25 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:23.370151 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2de9e0aa-1240-4555-b400-01068ee21c25 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:23.841056 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-2de9e0aa-1240-4555-b400-01068ee21c25 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:23.848677 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-2de9e0aa-1240-4555-b400-01068ee21c25 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1573 microversion: 2.1 time: 0.493617 Jul 14 14:36:23.849249 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 320/625] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:23 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1573 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:24.640777 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-4931dafa-74d6-4920-a174-62050f9d8835 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Action: 'create', calling method: .version_select at 0x7f416c40e940>, body: {"keypair": {"name": "tempest-keypair-1270997806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERfGgLC5lDFI9VvnzGHpoxx3g3euRpZloUDNhI6edv1BPhKC1XrIABuFH7Edo6FzRojcjPme3mFO4/N2/3d1fCSSBUdTwc6sVxkhh//hn+nPQVsTORZQOc3tVqDMrcjhg=="}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:24.655449 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-4931dafa-74d6-4920-a174-62050f9d8835 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Getting quotas for project 7378149db04942bdbc1035f0a3a902fe. Resources: {'key_pairs'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:24.659467 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-4931dafa-74d6-4920-a174-62050f9d8835 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Getting quotas for user 01c0469b67814077b4544cea54a0192e and project 7378149db04942bdbc1035f0a3a902fe. Resources: {'key_pairs'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:24.747725 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-4931dafa-74d6-4920-a174-62050f9d8835 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.220448 Jul 14 14:36:24.748568 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 306/626] 10.222.0.93 () {62 vars in 1199 bytes} [Thu Jul 14 14:36:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 222 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:36:24.866071 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c62dfd16-764d-4c41-b937-b8eedd171bf5 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:24.866990 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c62dfd16-764d-4c41-b937-b8eedd171bf5 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:24.873577 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c62dfd16-764d-4c41-b937-b8eedd171bf5 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:24.874047 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c62dfd16-764d-4c41-b937-b8eedd171bf5 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:24.874806 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c62dfd16-764d-4c41-b937-b8eedd171bf5 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:24.879971 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c62dfd16-764d-4c41-b937-b8eedd171bf5 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:25.076911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c62dfd16-764d-4c41-b937-b8eedd171bf5 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:25.087087 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c62dfd16-764d-4c41-b937-b8eedd171bf5 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1573 microversion: 2.1 time: 0.225172 Jul 14 14:36:25.087975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 321/627] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:24 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1573 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:26.119164 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-1e91daff-8499-454d-b53b-b8b29bb0e885 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:26.119859 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-1e91daff-8499-454d-b53b-b8b29bb0e885 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:26.136775 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1e91daff-8499-454d-b53b-b8b29bb0e885 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:26.139316 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1e91daff-8499-454d-b53b-b8b29bb0e885 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:26.139316 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1e91daff-8499-454d-b53b-b8b29bb0e885 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:26.139663 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1e91daff-8499-454d-b53b-b8b29bb0e885 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:26.357340 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-1e91daff-8499-454d-b53b-b8b29bb0e885 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:26.375561 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-1e91daff-8499-454d-b53b-b8b29bb0e885 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1573 microversion: 2.1 time: 0.274258 Jul 14 14:36:26.393694 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 307/628] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:26 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1573 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:27.396713 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-82903877-230c-44e6-b0c6-d7b11f0a52b0 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:27.398246 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-82903877-230c-44e6-b0c6-d7b11f0a52b0 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:27.406370 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-82903877-230c-44e6-b0c6-d7b11f0a52b0 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:27.406835 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-82903877-230c-44e6-b0c6-d7b11f0a52b0 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:27.410935 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-82903877-230c-44e6-b0c6-d7b11f0a52b0 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:27.410935 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-82903877-230c-44e6-b0c6-d7b11f0a52b0 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:27.569946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7dc1c3b7-a09a-4a11-b8d2-2ae18380452f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2013777124", "imageRef": "7ea875a4-facb-4053-be2d-ff0080d2f3a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44167c18-8a2e-4113-86a9-34428792d360"}], "security_groups": [{"name": "tempest-securitygroup--487474708"}], "key_name": "tempest-keypair-1270997806", "user_data": "}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:27.608894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-82903877-230c-44e6-b0c6-d7b11f0a52b0 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:27.618740 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-82903877-230c-44e6-b0c6-d7b11f0a52b0 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1573 microversion: 2.1 time: 0.225838 Jul 14 14:36:27.619324 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 322/629] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:27 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1573 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:27.712359 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.network.neutron [None req-7dc1c3b7-a09a-4a11-b8d2-2ae18380452f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] validate_networks() for [('44167c18-8a2e-4113-86a9-34428792d360', None, None, None, None, None)] {{(pid=118462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:36:28.195139 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-7dc1c3b7-a09a-4a11-b8d2-2ae18380452f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Flavor limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:36:28.195558 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-7dc1c3b7-a09a-4a11-b8d2-2ae18380452f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Image limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:36:28.196195 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-7dc1c3b7-a09a-4a11-b8d2-2ae18380452f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Flavor pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:36:28.196610 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-7dc1c3b7-a09a-4a11-b8d2-2ae18380452f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Image pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:36:28.197014 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-7dc1c3b7-a09a-4a11-b8d2-2ae18380452f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:36:28.205746 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7dc1c3b7-a09a-4a11-b8d2-2ae18380452f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:28.206215 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7dc1c3b7-a09a-4a11-b8d2-2ae18380452f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:28.207004 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7dc1c3b7-a09a-4a11-b8d2-2ae18380452f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:28.207432 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7dc1c3b7-a09a-4a11-b8d2-2ae18380452f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:28.224134 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-7dc1c3b7-a09a-4a11-b8d2-2ae18380452f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Getting quotas for project 7378149db04942bdbc1035f0a3a902fe. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:28.228205 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-7dc1c3b7-a09a-4a11-b8d2-2ae18380452f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Getting quotas for user 01c0469b67814077b4544cea54a0192e and project 7378149db04942bdbc1035f0a3a902fe. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:28.239824 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-7dc1c3b7-a09a-4a11-b8d2-2ae18380452f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Going to run 1 instances... {{(pid=118462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:36:28.242619 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-7dc1c3b7-a09a-4a11-b8d2-2ae18380452f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ea875a4-facb-4053-be2d-ff0080d2f3a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:36:28.365514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-7dc1c3b7-a09a-4a11-b8d2-2ae18380452f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.800380 Jul 14 14:36:28.366696 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 308/630] 10.222.0.93 () {62 vars in 1187 bytes} [Thu Jul 14 14:36:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:36:28.376669 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b67ca8f6-9d9d-4583-9390-fd32e091bbdd tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:28.377257 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b67ca8f6-9d9d-4583-9390-fd32e091bbdd tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:28.431962 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b67ca8f6-9d9d-4583-9390-fd32e091bbdd tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:28.439031 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-70d6d8e4-6773-4aa4-9ad9-0e4b6457a667 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1629415736"}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:28.439509 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-70d6d8e4-6773-4aa4-9ad9-0e4b6457a667 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:28.440342 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b67ca8f6-9d9d-4583-9390-fd32e091bbdd tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:28.442121 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b67ca8f6-9d9d-4583-9390-fd32e091bbdd tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:28.443700 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b67ca8f6-9d9d-4583-9390-fd32e091bbdd tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1282 microversion: 2.20 time: 0.071070 Jul 14 14:36:28.446158 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-70d6d8e4-6773-4aa4-9ad9-0e4b6457a667 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:28.446610 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-70d6d8e4-6773-4aa4-9ad9-0e4b6457a667 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:28.447388 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-70d6d8e4-6773-4aa4-9ad9-0e4b6457a667 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:28.447808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-70d6d8e4-6773-4aa4-9ad9-0e4b6457a667 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:28.454873 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 323/631] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:28 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1282 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:28.582267 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.network.security_group_api [None req-70d6d8e4-6773-4aa4-9ad9-0e4b6457a667 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Removing security group 3c343f85-3621-4b20-9be1-ea5b8c6477e9 from port 952e7af0-ae31-4c8d-891e-163bc4da7b6e Jul 14 14:36:28.642184 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-7f17c90a-fa4f-4fef-a791-a7bd9632f5ca tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:28.642705 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-7f17c90a-fa4f-4fef-a791-a7bd9632f5ca tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:28.649607 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7f17c90a-fa4f-4fef-a791-a7bd9632f5ca tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:28.650024 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7f17c90a-fa4f-4fef-a791-a7bd9632f5ca tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:28.651358 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7f17c90a-fa4f-4fef-a791-a7bd9632f5ca tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:28.651358 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7f17c90a-fa4f-4fef-a791-a7bd9632f5ca tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:28.897669 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7f17c90a-fa4f-4fef-a791-a7bd9632f5ca tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:28.901752 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-7f17c90a-fa4f-4fef-a791-a7bd9632f5ca tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1573 microversion: 2.1 time: 0.263464 Jul 14 14:36:28.902331 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 324/632] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:28 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1573 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:29.116523 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-70d6d8e4-6773-4aa4-9ad9-0e4b6457a667 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "POST /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d/action" status: 202 len: 0 microversion: 2.1 time: 0.674691 Jul 14 14:36:29.116523 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 309/633] 10.222.0.93 () {60 vars in 1277 bytes} [Thu Jul 14 14:36:28 2022] POST /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d/action => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:36:29.297371 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-d8ef7798-4046-45ea-91d4-676c369d2410 req-d54fa9ce-2c83-45dc-8273-81b830ce088f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19ce733-1092-4a21-9c56-5f3b570afb2d", "tag": "952e7af0-ae31-4c8d-891e-163bc4da7b6e"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:29.306093 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-d8ef7798-4046-45ea-91d4-676c369d2410 req-d54fa9ce-2c83-45dc-8273-81b830ce088f service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:29.306743 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-d8ef7798-4046-45ea-91d4-676c369d2410 req-d54fa9ce-2c83-45dc-8273-81b830ce088f service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:29.325856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-d8ef7798-4046-45ea-91d4-676c369d2410 req-d54fa9ce-2c83-45dc-8273-81b830ce088f service nova] Creating event network-changed:952e7af0-ae31-4c8d-891e-163bc4da7b6e for instance e19ce733-1092-4a21-9c56-5f3b570afb2d on hv-cinder-79987 Jul 14 14:36:29.338356 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-d8ef7798-4046-45ea-91d4-676c369d2410 req-d54fa9ce-2c83-45dc-8273-81b830ce088f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223677 Jul 14 14:36:29.338960 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 325/634] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:36:29.463407 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a5d10e43-0c8d-4f11-9cbf-6df0015499d7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:29.464032 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a5d10e43-0c8d-4f11-9cbf-6df0015499d7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:29.536659 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a5d10e43-0c8d-4f11-9cbf-6df0015499d7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:29.545804 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a5d10e43-0c8d-4f11-9cbf-6df0015499d7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:29.548144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a5d10e43-0c8d-4f11-9cbf-6df0015499d7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:29.549624 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a5d10e43-0c8d-4f11-9cbf-6df0015499d7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1282 microversion: 2.20 time: 0.091322 Jul 14 14:36:29.550976 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 310/635] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:29 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:29.920745 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-dd0c5941-5cc9-4379-a6b1-93806d6b1b4d tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:29.921483 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-dd0c5941-5cc9-4379-a6b1-93806d6b1b4d tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:29.928051 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dd0c5941-5cc9-4379-a6b1-93806d6b1b4d tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:29.929217 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dd0c5941-5cc9-4379-a6b1-93806d6b1b4d tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:29.930139 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dd0c5941-5cc9-4379-a6b1-93806d6b1b4d tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:29.930555 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dd0c5941-5cc9-4379-a6b1-93806d6b1b4d tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:30.068722 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-dd0c5941-5cc9-4379-a6b1-93806d6b1b4d tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:30.077112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-dd0c5941-5cc9-4379-a6b1-93806d6b1b4d tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1573 microversion: 2.1 time: 0.161020 Jul 14 14:36:30.086448 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 326/636] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:29 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:30.568733 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f9225f34-5172-4e1a-bb8b-8f8d46bccace tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:30.569906 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f9225f34-5172-4e1a-bb8b-8f8d46bccace tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:30.577377 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f9225f34-5172-4e1a-bb8b-8f8d46bccace tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:30.577844 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f9225f34-5172-4e1a-bb8b-8f8d46bccace tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:30.582046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f9225f34-5172-4e1a-bb8b-8f8d46bccace tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:30.582046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f9225f34-5172-4e1a-bb8b-8f8d46bccace tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:30.641362 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f9225f34-5172-4e1a-bb8b-8f8d46bccace tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:30.650397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f9225f34-5172-4e1a-bb8b-8f8d46bccace tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:30.651935 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f9225f34-5172-4e1a-bb8b-8f8d46bccace tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:30.653050 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f9225f34-5172-4e1a-bb8b-8f8d46bccace tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1278 microversion: 2.20 time: 0.088439 Jul 14 14:36:30.653590 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 311/637] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:30 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:30.864060 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-a6c0d5e5-c393-4787-9dd8-5e82c91cbd9f req-5d83909c-47b5-404e-a644-fc77364349f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833f486d-a5d2-41ff-8404-19f21892e73c", "name": "network-vif-plugged", "status": "completed", "tag": "7f554063-5f76-4260-95f2-f9417cf2981a"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:30.873183 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-a6c0d5e5-c393-4787-9dd8-5e82c91cbd9f req-5d83909c-47b5-404e-a644-fc77364349f0 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:30.873623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-a6c0d5e5-c393-4787-9dd8-5e82c91cbd9f req-5d83909c-47b5-404e-a644-fc77364349f0 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:30.884975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-a6c0d5e5-c393-4787-9dd8-5e82c91cbd9f req-5d83909c-47b5-404e-a644-fc77364349f0 service nova] Creating event network-vif-plugged:7f554063-5f76-4260-95f2-f9417cf2981a for instance 833f486d-a5d2-41ff-8404-19f21892e73c on hv-cinder-79987 Jul 14 14:36:30.889811 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-a6c0d5e5-c393-4787-9dd8-5e82c91cbd9f req-5d83909c-47b5-404e-a644-fc77364349f0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029377 Jul 14 14:36:30.890400 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 327/638] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:31.098189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7c2717d8-d6b4-40c2-935b-b7df64453a0b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:31.099601 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-7c2717d8-d6b4-40c2-935b-b7df64453a0b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:31.108494 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7c2717d8-d6b4-40c2-935b-b7df64453a0b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:31.108941 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7c2717d8-d6b4-40c2-935b-b7df64453a0b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:31.109705 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7c2717d8-d6b4-40c2-935b-b7df64453a0b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:31.110160 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7c2717d8-d6b4-40c2-935b-b7df64453a0b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:31.141255 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-10ac2101-ccf3-4b69-9f92-929199d3187c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:31.142482 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-10ac2101-ccf3-4b69-9f92-929199d3187c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:31.151197 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-10ac2101-ccf3-4b69-9f92-929199d3187c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:31.151740 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-10ac2101-ccf3-4b69-9f92-929199d3187c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:31.152780 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-10ac2101-ccf3-4b69-9f92-929199d3187c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:31.153433 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-10ac2101-ccf3-4b69-9f92-929199d3187c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:31.254317 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.objects.instance [None req-10ac2101-ccf3-4b69-9f92-929199d3187c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lazy-loading 'services' on Instance uuid e19ce733-1092-4a21-9c56-5f3b570afb2d {{(pid=118461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:36:31.323762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7c2717d8-d6b4-40c2-935b-b7df64453a0b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:31.338076 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-7c2717d8-d6b4-40c2-935b-b7df64453a0b tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1573 microversion: 2.1 time: 0.242761 Jul 14 14:36:31.339697 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 312/639] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:31 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1573 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:31.435066 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-3933e1e5-2a68-444a-814f-cc48624aa550 req-a28de49a-d945-4464-8998-dfc7c88ea1bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19ce733-1092-4a21-9c56-5f3b570afb2d", "tag": "952e7af0-ae31-4c8d-891e-163bc4da7b6e"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:31.444215 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-3933e1e5-2a68-444a-814f-cc48624aa550 req-a28de49a-d945-4464-8998-dfc7c88ea1bd service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:31.445010 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-3933e1e5-2a68-444a-814f-cc48624aa550 req-a28de49a-d945-4464-8998-dfc7c88ea1bd service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:31.460880 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-3933e1e5-2a68-444a-814f-cc48624aa550 req-a28de49a-d945-4464-8998-dfc7c88ea1bd service nova] Creating event network-changed:952e7af0-ae31-4c8d-891e-163bc4da7b6e for instance e19ce733-1092-4a21-9c56-5f3b570afb2d on hv-cinder-79987 Jul 14 14:36:31.467342 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-3933e1e5-2a68-444a-814f-cc48624aa550 req-a28de49a-d945-4464-8998-dfc7c88ea1bd service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126220 Jul 14 14:36:31.468272 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 313/640] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:31.568239 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-10ac2101-ccf3-4b69-9f92-929199d3187c tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d/os-volume_attachments/c7535421-97bf-49e7-85e1-fde378d7dee7" status: 202 len: 0 microversion: 2.1 time: 0.438611 Jul 14 14:36:31.568977 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 328/641] 10.222.0.93 () {58 vars in 1415 bytes} [Thu Jul 14 14:36:31 2022] DELETE /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d/os-volume_attachments/c7535421-97bf-49e7-85e1-fde378d7dee7 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:36:31.578604 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-57d80afa-1b76-42ba-a2c5-7a954d4f09d8 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:31.579708 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-57d80afa-1b76-42ba-a2c5-7a954d4f09d8 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:31.585898 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-57d80afa-1b76-42ba-a2c5-7a954d4f09d8 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:31.586340 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-57d80afa-1b76-42ba-a2c5-7a954d4f09d8 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:31.587429 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-57d80afa-1b76-42ba-a2c5-7a954d4f09d8 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:31.587867 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-57d80afa-1b76-42ba-a2c5-7a954d4f09d8 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:31.619924 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-57d80afa-1b76-42ba-a2c5-7a954d4f09d8 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046074 Jul 14 14:36:31.620778 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 314/642] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:36:31 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:31.672856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-96fbb08f-69aa-4aa8-8788-387309d637ae tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:31.674170 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-96fbb08f-69aa-4aa8-8788-387309d637ae tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:31.689782 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-96fbb08f-69aa-4aa8-8788-387309d637ae tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:31.690232 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-96fbb08f-69aa-4aa8-8788-387309d637ae tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:31.691019 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-96fbb08f-69aa-4aa8-8788-387309d637ae tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:31.691463 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-96fbb08f-69aa-4aa8-8788-387309d637ae tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:31.787461 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-96fbb08f-69aa-4aa8-8788-387309d637ae tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:31.802566 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-96fbb08f-69aa-4aa8-8788-387309d637ae tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:31.804258 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-96fbb08f-69aa-4aa8-8788-387309d637ae tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:31.805407 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-96fbb08f-69aa-4aa8-8788-387309d637ae tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1342 microversion: 2.20 time: 0.138008 Jul 14 14:36:31.816739 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 329/643] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:31 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1342 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:32.416664 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-37cc8327-99e5-48b6-9d9d-ba746859f452 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:32.417290 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-37cc8327-99e5-48b6-9d9d-ba746859f452 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:32.423712 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-37cc8327-99e5-48b6-9d9d-ba746859f452 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:32.424238 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-37cc8327-99e5-48b6-9d9d-ba746859f452 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:32.425058 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-37cc8327-99e5-48b6-9d9d-ba746859f452 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:32.425563 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-37cc8327-99e5-48b6-9d9d-ba746859f452 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:32.569162 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-37cc8327-99e5-48b6-9d9d-ba746859f452 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:32.577174 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-37cc8327-99e5-48b6-9d9d-ba746859f452 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1573 microversion: 2.1 time: 0.164974 Jul 14 14:36:32.577744 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 315/644] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:32 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:32.633317 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d04d753a-7c02-4261-90bd-401bc6e8ae10 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:32.634342 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d04d753a-7c02-4261-90bd-401bc6e8ae10 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:32.640951 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d04d753a-7c02-4261-90bd-401bc6e8ae10 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:32.641395 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d04d753a-7c02-4261-90bd-401bc6e8ae10 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:32.642185 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d04d753a-7c02-4261-90bd-401bc6e8ae10 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:32.642615 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d04d753a-7c02-4261-90bd-401bc6e8ae10 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:32.675342 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d04d753a-7c02-4261-90bd-401bc6e8ae10 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044525 Jul 14 14:36:32.675342 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 330/645] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:36:32 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:32.827595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-1e73edfe-732c-4d3c-a716-a670e02fcd91 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:32.828622 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-1e73edfe-732c-4d3c-a716-a670e02fcd91 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:32.837728 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1e73edfe-732c-4d3c-a716-a670e02fcd91 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:32.838479 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1e73edfe-732c-4d3c-a716-a670e02fcd91 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:32.839470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1e73edfe-732c-4d3c-a716-a670e02fcd91 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:32.839936 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1e73edfe-732c-4d3c-a716-a670e02fcd91 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:32.933187 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-1e73edfe-732c-4d3c-a716-a670e02fcd91 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:32.941536 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-1e73edfe-732c-4d3c-a716-a670e02fcd91 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:32.943201 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-1e73edfe-732c-4d3c-a716-a670e02fcd91 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:32.944833 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-1e73edfe-732c-4d3c-a716-a670e02fcd91 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1340 microversion: 2.20 time: 0.124214 Jul 14 14:36:32.945446 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 316/646] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:32 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1340 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:33.594790 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b276a74b-2550-420d-a881-b8b4d2b12b45 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:33.595487 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b276a74b-2550-420d-a881-b8b4d2b12b45 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:33.602127 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b276a74b-2550-420d-a881-b8b4d2b12b45 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:33.602651 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b276a74b-2550-420d-a881-b8b4d2b12b45 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:33.603397 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b276a74b-2550-420d-a881-b8b4d2b12b45 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:33.603816 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b276a74b-2550-420d-a881-b8b4d2b12b45 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:33.685214 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0ae881c7-0d61-486e-9117-9ef6b091c5a6 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:33.687323 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0ae881c7-0d61-486e-9117-9ef6b091c5a6 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:33.695685 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ae881c7-0d61-486e-9117-9ef6b091c5a6 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:33.701683 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ae881c7-0d61-486e-9117-9ef6b091c5a6 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:33.701683 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ae881c7-0d61-486e-9117-9ef6b091c5a6 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:33.701683 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ae881c7-0d61-486e-9117-9ef6b091c5a6 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:33.727598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0ae881c7-0d61-486e-9117-9ef6b091c5a6 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046293 Jul 14 14:36:33.728484 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 317/647] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:36:33 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 14:36:33.738544 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-3097f649-8297-4cb7-b8b7-04ab0f41459f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:33.741726 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-3097f649-8297-4cb7-b8b7-04ab0f41459f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:33.746877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3097f649-8297-4cb7-b8b7-04ab0f41459f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:33.747323 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3097f649-8297-4cb7-b8b7-04ab0f41459f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:33.748279 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3097f649-8297-4cb7-b8b7-04ab0f41459f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:33.748915 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3097f649-8297-4cb7-b8b7-04ab0f41459f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:33.762057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b276a74b-2550-420d-a881-b8b4d2b12b45 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:33.771119 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b276a74b-2550-420d-a881-b8b4d2b12b45 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1560 microversion: 2.1 time: 0.180145 Jul 14 14:36:33.772561 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 331/648] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:33 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:33.836102 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-3097f649-8297-4cb7-b8b7-04ab0f41459f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] HTTP exception thrown: Instance e19ce733-1092-4a21-9c56-5f3b570afb2d is not attached to volume c7535421-97bf-49e7-85e1-fde378d7dee7 Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-3097f649-8297-4cb7-b8b7-04ab0f41459f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Request method failure captured: Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: DELETE /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d/os-volume_attachments/c7535421-97bf-49e7-85e1-fde378d7dee7 HTTP/1.1 Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0ClXT3adAUTYRjTOC1VNRo3b4ITqXT2he39TuZl629Gep4aYDWEalIMjWs-fn54FKGCsynBbFf8-d2sugKLrh1rJtB58FXAcP1FaqGepigOKEdoIE2uW9CnSJJkhZ5c9fouATWdKnkHC0lFeB28fFpL74ZJyDlzBabZd0xAF2j6HWx8 Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: 8ae0529df8aa4640806b4e7f3680e87b Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-TestMinimumBasicScenario-1637113758 Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:36:33.838957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:36:33.840644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8ae0529df8aa4640806b4e7f3680e87b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8ae0529df8aa4640806b4e7f3680e87b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8ae0529df8aa4640806b4e7f3680e87b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8ae0529df8aa4640806b4e7f3680e87b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:36:33.840644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-TestMinimumBasicScenario-1637113758 Jul 14 14:36:33.840644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: 8ae0529df8aa4640806b4e7f3680e87b Jul 14 14:36:33.840644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1637113758 Jul 14 14:36:33.840644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-TestMinimumBasicScenario-1637113758-project Jul 14 14:36:33.840644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:36:33.840644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:36:33.840644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 73045af76072450a999de6d3fc5962e6 Jul 14 14:36:33.840644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-TestMinimumBasicScenario-1637113758-project Jul 14 14:36:33.840644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:36:33.840644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance e19ce733-1092-4a21-9c56-5f3b570afb2d is not attached to volume c7535421-97bf-49e7-85e1-fde378d7dee7 Jul 14 14:36:33.841435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'server_id': 'e19ce733-1092-4a21-9c56-5f3b570afb2d', 'id': 'c7535421-97bf-49e7-85e1-fde378d7dee7'} Jul 14 14:36:33.841435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:33.841435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:33.841435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 14:36:33.841435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 14:36:33.841435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:36:33.841435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:36:33.841435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 14:36:33.841435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 14:36:33.841435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c7535421-97bf-49e7-85e1-fde378d7dee7. Jul 14 14:36:33.841435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:36:33.841435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:33.841435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:36:33.841435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:33.841435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:33.841435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:33.841435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:33.841435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:33.841435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:33.842765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:33.842765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 14:36:33.842765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 14:36:33.842765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19ce733-1092-4a21-9c56-5f3b570afb2d is not attached to volume c7535421-97bf-49e7-85e1-fde378d7dee7 Jul 14 14:36:33.842765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:36:33.842765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:33.842765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:36:33.842765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:33.842765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:33.842765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:33.842765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:33.842765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:33.842765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19ce733-1092-4a21-9c56-5f3b570afb2d is not attached to volume c7535421-97bf-49e7-85e1-fde378d7dee7 Jul 14 14:36:33.842765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:36:33.842765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-3097f649-8297-4cb7-b8b7-04ab0f41459f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Returning 404 to user: Instance e19ce733-1092-4a21-9c56-5f3b570afb2d is not attached to volume c7535421-97bf-49e7-85e1-fde378d7dee7 {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:33.843667 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-3097f649-8297-4cb7-b8b7-04ab0f41459f tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d/os-volume_attachments/c7535421-97bf-49e7-85e1-fde378d7dee7" status: 404 len: 154 microversion: 2.1 time: 0.105805 Jul 14 14:36:33.843667 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 318/649] 10.222.0.93 () {58 vars in 1415 bytes} [Thu Jul 14 14:36:33 2022] DELETE /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d/os-volume_attachments/c7535421-97bf-49e7-85e1-fde378d7dee7 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:36:33.963319 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-13a5302a-fcce-4075-a89c-0376fcbe5546 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:33.964239 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-13a5302a-fcce-4075-a89c-0376fcbe5546 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:33.971683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-13a5302a-fcce-4075-a89c-0376fcbe5546 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:33.972082 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-13a5302a-fcce-4075-a89c-0376fcbe5546 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:33.972736 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-13a5302a-fcce-4075-a89c-0376fcbe5546 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:33.973165 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-13a5302a-fcce-4075-a89c-0376fcbe5546 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:34.118262 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-13a5302a-fcce-4075-a89c-0376fcbe5546 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:34.128762 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-13a5302a-fcce-4075-a89c-0376fcbe5546 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:34.130660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-13a5302a-fcce-4075-a89c-0376fcbe5546 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:34.131980 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-13a5302a-fcce-4075-a89c-0376fcbe5546 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1407 microversion: 2.20 time: 0.173203 Jul 14 14:36:34.132947 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 332/650] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:33 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:34.825379 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-fba00e99-3975-4853-8680-3822c9d26bfa req-6527358d-b9a9-4586-849b-476ce0952fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d810a21-86d3-4d18-b9d6-eae39990ac26", "tag": "56e9cb11-f5b0-4131-82d8-c97417b17d2c"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:34.842982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-fba00e99-3975-4853-8680-3822c9d26bfa req-6527358d-b9a9-4586-849b-476ce0952fc0 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:34.842982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-fba00e99-3975-4853-8680-3822c9d26bfa req-6527358d-b9a9-4586-849b-476ce0952fc0 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:34.849425 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-fba00e99-3975-4853-8680-3822c9d26bfa req-6527358d-b9a9-4586-849b-476ce0952fc0 service nova] Creating event network-changed:56e9cb11-f5b0-4131-82d8-c97417b17d2c for instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 on hv-cinder-79987 Jul 14 14:36:34.855597 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-fba00e99-3975-4853-8680-3822c9d26bfa req-6527358d-b9a9-4586-849b-476ce0952fc0 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034607 Jul 14 14:36:34.856288 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 319/651] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:35.150410 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-5be75efd-2b94-4cbe-9885-5df2506633a2 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:35.150410 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-5be75efd-2b94-4cbe-9885-5df2506633a2 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:35.159721 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5be75efd-2b94-4cbe-9885-5df2506633a2 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:35.160165 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5be75efd-2b94-4cbe-9885-5df2506633a2 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:35.161057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5be75efd-2b94-4cbe-9885-5df2506633a2 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:35.162249 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5be75efd-2b94-4cbe-9885-5df2506633a2 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:35.198253 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-1408d528-1844-411f-b1dc-ee9b4bf940f5 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:35.199094 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-1408d528-1844-411f-b1dc-ee9b4bf940f5 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:35.205954 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1408d528-1844-411f-b1dc-ee9b4bf940f5 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:35.206407 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1408d528-1844-411f-b1dc-ee9b4bf940f5 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:35.207175 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1408d528-1844-411f-b1dc-ee9b4bf940f5 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:35.207837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1408d528-1844-411f-b1dc-ee9b4bf940f5 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:35.235699 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-1408d528-1844-411f-b1dc-ee9b4bf940f5 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Going to try to terminate instance {{(pid=118462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:36:35.311811 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5be75efd-2b94-4cbe-9885-5df2506633a2 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:35.322336 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5be75efd-2b94-4cbe-9885-5df2506633a2 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:35.323893 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5be75efd-2b94-4cbe-9885-5df2506633a2 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:35.325164 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-5be75efd-2b94-4cbe-9885-5df2506633a2 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1407 microversion: 2.20 time: 0.178919 Jul 14 14:36:35.325598 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 333/652] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:35 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:35.557076 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-1408d528-1844-411f-b1dc-ee9b4bf940f5 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "DELETE /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 204 len: 0 microversion: 2.1 time: 0.362751 Jul 14 14:36:35.557791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 320/653] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:36:35 2022] DELETE /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:36:35.565911 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-fc7273a8-0fdb-4110-941f-ec4efefdd1c4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:35.571423 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-fc7273a8-0fdb-4110-941f-ec4efefdd1c4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:35.572912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fc7273a8-0fdb-4110-941f-ec4efefdd1c4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:35.573438 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fc7273a8-0fdb-4110-941f-ec4efefdd1c4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:35.574961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fc7273a8-0fdb-4110-941f-ec4efefdd1c4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:35.575576 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fc7273a8-0fdb-4110-941f-ec4efefdd1c4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:35.705291 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-fc7273a8-0fdb-4110-941f-ec4efefdd1c4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:35.714456 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-fc7273a8-0fdb-4110-941f-ec4efefdd1c4 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1553 microversion: 2.1 time: 0.152452 Jul 14 14:36:35.715122 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 334/654] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:35 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:36.344642 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-cd2b3535-20d5-4cbb-a53e-e20e63757273 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:36.345233 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-cd2b3535-20d5-4cbb-a53e-e20e63757273 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:36.352246 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cd2b3535-20d5-4cbb-a53e-e20e63757273 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:36.352684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cd2b3535-20d5-4cbb-a53e-e20e63757273 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:36.353429 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cd2b3535-20d5-4cbb-a53e-e20e63757273 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:36.353875 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cd2b3535-20d5-4cbb-a53e-e20e63757273 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:36.486702 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-cd2b3535-20d5-4cbb-a53e-e20e63757273 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:36.494626 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-cd2b3535-20d5-4cbb-a53e-e20e63757273 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:36.496141 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-cd2b3535-20d5-4cbb-a53e-e20e63757273 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:36.497272 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-cd2b3535-20d5-4cbb-a53e-e20e63757273 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1407 microversion: 2.20 time: 0.157009 Jul 14 14:36:36.497862 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 321/655] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:36 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:36.732289 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f112c2f5-b8e2-4b69-a270-6b7ec2d727b7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:36.732857 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-f112c2f5-b8e2-4b69-a270-6b7ec2d727b7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:36.739248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f112c2f5-b8e2-4b69-a270-6b7ec2d727b7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:36.739679 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f112c2f5-b8e2-4b69-a270-6b7ec2d727b7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:36.740418 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f112c2f5-b8e2-4b69-a270-6b7ec2d727b7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:36.740865 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f112c2f5-b8e2-4b69-a270-6b7ec2d727b7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:36.869789 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-f112c2f5-b8e2-4b69-a270-6b7ec2d727b7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:36.877139 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-f112c2f5-b8e2-4b69-a270-6b7ec2d727b7 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1553 microversion: 2.1 time: 0.149059 Jul 14 14:36:36.877698 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 335/656] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:36 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:37.515332 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b94533e7-389e-4fa6-9ce4-afab27be6670 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:37.515955 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b94533e7-389e-4fa6-9ce4-afab27be6670 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:37.522442 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b94533e7-389e-4fa6-9ce4-afab27be6670 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:37.522885 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b94533e7-389e-4fa6-9ce4-afab27be6670 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:37.524410 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b94533e7-389e-4fa6-9ce4-afab27be6670 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:37.524834 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b94533e7-389e-4fa6-9ce4-afab27be6670 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:37.656077 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b94533e7-389e-4fa6-9ce4-afab27be6670 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:37.664448 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b94533e7-389e-4fa6-9ce4-afab27be6670 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:37.665990 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b94533e7-389e-4fa6-9ce4-afab27be6670 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:37.667083 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b94533e7-389e-4fa6-9ce4-afab27be6670 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1407 microversion: 2.20 time: 0.155684 Jul 14 14:36:37.667663 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 322/657] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:37 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:37.894652 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4f46f666-e6a0-48f0-abe8-60de116c71c1 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:37.895192 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-4f46f666-e6a0-48f0-abe8-60de116c71c1 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:37.901654 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f46f666-e6a0-48f0-abe8-60de116c71c1 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:37.902157 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f46f666-e6a0-48f0-abe8-60de116c71c1 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:37.902892 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f46f666-e6a0-48f0-abe8-60de116c71c1 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:37.903338 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f46f666-e6a0-48f0-abe8-60de116c71c1 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:37.922945 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:38.039160 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4f46f666-e6a0-48f0-abe8-60de116c71c1 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:38.046970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4f46f666-e6a0-48f0-abe8-60de116c71c1 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1553 microversion: 2.1 time: 0.156158 Jul 14 14:36:38.047548 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 336/658] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:37 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:38.584539 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-6cf22604-21fa-4937-82e2-fbcb7bafdc47 req-148ff389-5911-419e-926d-459b21b09a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19ce733-1092-4a21-9c56-5f3b570afb2d", "name": "network-vif-deleted", "tag": "952e7af0-ae31-4c8d-891e-163bc4da7b6e"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:38.588263 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=2 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:38.594039 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-6cf22604-21fa-4937-82e2-fbcb7bafdc47 req-148ff389-5911-419e-926d-459b21b09a1e service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:38.597857 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-6cf22604-21fa-4937-82e2-fbcb7bafdc47 req-148ff389-5911-419e-926d-459b21b09a1e service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:38.606887 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-6cf22604-21fa-4937-82e2-fbcb7bafdc47 req-148ff389-5911-419e-926d-459b21b09a1e service nova] Creating event network-vif-deleted:952e7af0-ae31-4c8d-891e-163bc4da7b6e for instance e19ce733-1092-4a21-9c56-5f3b570afb2d on hv-cinder-79987 Jul 14 14:36:38.611786 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-6cf22604-21fa-4937-82e2-fbcb7bafdc47 req-148ff389-5911-419e-926d-459b21b09a1e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030918 Jul 14 14:36:38.612572 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 323/659] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:38.685015 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-5e4702e6-b2bb-4a44-9da6-4c92af740fe7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:38.685644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-5e4702e6-b2bb-4a44-9da6-4c92af740fe7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:38.687781 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:38.692749 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5e4702e6-b2bb-4a44-9da6-4c92af740fe7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:38.693185 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5e4702e6-b2bb-4a44-9da6-4c92af740fe7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:38.693966 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5e4702e6-b2bb-4a44-9da6-4c92af740fe7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:38.694406 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5e4702e6-b2bb-4a44-9da6-4c92af740fe7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:38.824967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5e4702e6-b2bb-4a44-9da6-4c92af740fe7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:38.832931 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5e4702e6-b2bb-4a44-9da6-4c92af740fe7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:38.834480 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5e4702e6-b2bb-4a44-9da6-4c92af740fe7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:38.836098 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-5e4702e6-b2bb-4a44-9da6-4c92af740fe7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1407 microversion: 2.20 time: 0.154572 Jul 14 14:36:38.837121 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 337/660] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:38 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:39.065051 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-cbe95274-3435-422f-9608-505db8d79cfa tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:39.065749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-cbe95274-3435-422f-9608-505db8d79cfa tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:39.072495 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cbe95274-3435-422f-9608-505db8d79cfa tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:39.072947 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cbe95274-3435-422f-9608-505db8d79cfa tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:39.073709 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cbe95274-3435-422f-9608-505db8d79cfa tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:39.074184 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cbe95274-3435-422f-9608-505db8d79cfa tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:39.105721 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cbe95274-3435-422f-9608-505db8d79cfa tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:39.106196 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cbe95274-3435-422f-9608-505db8d79cfa tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:39.106647 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-cbe95274-3435-422f-9608-505db8d79cfa tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lazy-loading 'fault' on Instance uuid e19ce733-1092-4a21-9c56-5f3b570afb2d {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:36:39.151456 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-cbe95274-3435-422f-9608-505db8d79cfa tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73045af76072450a999de6d3fc5962e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae0529df8aa4640806b4e7f3680e87b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:39.159064 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-cbe95274-3435-422f-9608-505db8d79cfa tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 200 len: 1348 microversion: 2.1 time: 0.098349 Jul 14 14:36:39.159659 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 324/661] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:39 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:39.856207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a091c7d2-1931-4fa3-b15d-130ed0e827d9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:39.856922 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a091c7d2-1931-4fa3-b15d-130ed0e827d9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:39.865656 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a091c7d2-1931-4fa3-b15d-130ed0e827d9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:39.866159 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a091c7d2-1931-4fa3-b15d-130ed0e827d9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:39.866917 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a091c7d2-1931-4fa3-b15d-130ed0e827d9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:39.867330 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a091c7d2-1931-4fa3-b15d-130ed0e827d9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:40.000478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a091c7d2-1931-4fa3-b15d-130ed0e827d9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:40.009002 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a091c7d2-1931-4fa3-b15d-130ed0e827d9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:40.010625 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a091c7d2-1931-4fa3-b15d-130ed0e827d9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:40.011831 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a091c7d2-1931-4fa3-b15d-130ed0e827d9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1407 microversion: 2.20 time: 0.160828 Jul 14 14:36:40.012366 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 338/662] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:39 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:36:40.095907 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-2a6e050d-e8dd-49db-83fd-6aadfddf2afb tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:40.096472 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-2a6e050d-e8dd-49db-83fd-6aadfddf2afb tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:40.098380 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=12 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:40.103796 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2a6e050d-e8dd-49db-83fd-6aadfddf2afb tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:40.104170 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2a6e050d-e8dd-49db-83fd-6aadfddf2afb tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:40.111400 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2a6e050d-e8dd-49db-83fd-6aadfddf2afb tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:40.111400 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2a6e050d-e8dd-49db-83fd-6aadfddf2afb tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:40.111400 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:40.130690 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-2a6e050d-e8dd-49db-83fd-6aadfddf2afb tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/ips" status: 200 len: 146 microversion: 2.1 time: 0.038645 Jul 14 14:36:40.131264 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 325/663] 10.222.0.93 () {58 vars in 1247 bytes} [Thu Jul 14 14:36:40 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:40.176294 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-80e7655c-8dd6-40f7-a125-2aed1381a0f0 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:40.176937 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-80e7655c-8dd6-40f7-a125-2aed1381a0f0 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] [instance: e19ce733-1092-4a21-9c56-5f3b570afb2d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:40.184213 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-80e7655c-8dd6-40f7-a125-2aed1381a0f0 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:40.185192 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-80e7655c-8dd6-40f7-a125-2aed1381a0f0 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:40.185416 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-80e7655c-8dd6-40f7-a125-2aed1381a0f0 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:40.185877 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-80e7655c-8dd6-40f7-a125-2aed1381a0f0 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:40.199869 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-80e7655c-8dd6-40f7-a125-2aed1381a0f0 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] HTTP exception thrown: Instance e19ce733-1092-4a21-9c56-5f3b570afb2d could not be found. Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-80e7655c-8dd6-40f7-a125-2aed1381a0f0 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Request method failure captured: Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d HTTP/1.1 Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0ClXT3adAUTYRjTOC1VNRo3b4ITqXT2he39TuZl629Gep4aYDWEalIMjWs-fn54FKGCsynBbFf8-d2sugKLrh1rJtB58FXAcP1FaqGepigOKEdoIE2uW9CnSJJkhZ5c9fouATWdKnkHC0lFeB28fFpL74ZJyDlzBabZd0xAF2j6HWx8 Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: 8ae0529df8aa4640806b4e7f3680e87b Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-TestMinimumBasicScenario-1637113758 Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:36:40.201570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:36:40.202975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_8ae0529df8aa4640806b4e7f3680e87b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8ae0529df8aa4640806b4e7f3680e87b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/8ae0529df8aa4640806b4e7f3680e87b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/8ae0529df8aa4640806b4e7f3680e87b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:36:40.202975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-TestMinimumBasicScenario-1637113758 Jul 14 14:36:40.202975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: 8ae0529df8aa4640806b4e7f3680e87b Jul 14 14:36:40.202975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1637113758 Jul 14 14:36:40.202975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-TestMinimumBasicScenario-1637113758-project Jul 14 14:36:40.202975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:36:40.202975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:36:40.202975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: 73045af76072450a999de6d3fc5962e6 Jul 14 14:36:40.202975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-TestMinimumBasicScenario-1637113758-project Jul 14 14:36:40.202975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:36:40.202975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Instance e19ce733-1092-4a21-9c56-5f3b570afb2d could not be found. Jul 14 14:36:40.202975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': 'e19ce733-1092-4a21-9c56-5f3b570afb2d'} Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19ce733-1092-4a21-9c56-5f3b570afb2d could not be found. Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:40.204004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:40.205671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:40.205671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:36:40.205671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:36:40.205671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:36:40.205671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:36:40.205671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:36:40.205671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:36:40.205671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19ce733-1092-4a21-9c56-5f3b570afb2d could not be found. Jul 14 14:36:40.205671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:36:40.205671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:40.205671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:36:40.205671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:40.205671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:40.205671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:40.205671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:40.205671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:40.205671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19ce733-1092-4a21-9c56-5f3b570afb2d could not be found. Jul 14 14:36:40.205671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:36:40.207920 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-80e7655c-8dd6-40f7-a125-2aed1381a0f0 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Returning 404 to user: Instance e19ce733-1092-4a21-9c56-5f3b570afb2d could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:40.207920 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-80e7655c-8dd6-40f7-a125-2aed1381a0f0 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d" status: 404 len: 111 microversion: 2.1 time: 0.030500 Jul 14 14:36:40.207920 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 339/664] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:40 2022] GET /compute/v2.1/servers/e19ce733-1092-4a21-9c56-5f3b570afb2d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:36:40.212397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-22ef9c4c-c61a-43ec-8f8d-44de09d21816 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] Calling method '.version_select at 0x7f416c4908b0>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:40.307902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-22ef9c4c-c61a-43ec-8f8d-44de09d21816 tempest-TestMinimumBasicScenario-1637113758 tempest-TestMinimumBasicScenario-1637113758-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-601209965" status: 202 len: 0 microversion: 2.1 time: 0.099755 Jul 14 14:36:40.308409 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 326/665] 10.222.0.93 () {58 vars in 1268 bytes} [Thu Jul 14 14:36:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-601209965 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:36:41.031900 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d60a0a60-223b-4894-8dd8-5878423e3e20 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:41.034042 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d60a0a60-223b-4894-8dd8-5878423e3e20 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:41.047717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d60a0a60-223b-4894-8dd8-5878423e3e20 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:41.047717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d60a0a60-223b-4894-8dd8-5878423e3e20 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:41.048579 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d60a0a60-223b-4894-8dd8-5878423e3e20 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:41.049307 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d60a0a60-223b-4894-8dd8-5878423e3e20 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:41.115686 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-e45553ca-c3ae-4697-b9ad-9989d1767f76 req-f6d02508-0db6-40eb-9325-75c378e2ba8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d810a21-86d3-4d18-b9d6-eae39990ac26", "name": "network-vif-plugged", "status": "completed", "tag": "56e9cb11-f5b0-4131-82d8-c97417b17d2c"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:41.119458 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:41.125661 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-e45553ca-c3ae-4697-b9ad-9989d1767f76 req-f6d02508-0db6-40eb-9325-75c378e2ba8c service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:41.126135 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-e45553ca-c3ae-4697-b9ad-9989d1767f76 req-f6d02508-0db6-40eb-9325-75c378e2ba8c service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:41.136866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-e45553ca-c3ae-4697-b9ad-9989d1767f76 req-f6d02508-0db6-40eb-9325-75c378e2ba8c service nova] Creating event network-vif-plugged:56e9cb11-f5b0-4131-82d8-c97417b17d2c for instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 on hv-cinder-79987 Jul 14 14:36:41.141883 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-e45553ca-c3ae-4697-b9ad-9989d1767f76 req-f6d02508-0db6-40eb-9325-75c378e2ba8c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091322 Jul 14 14:36:41.142479 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 327/666] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:41.198320 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d60a0a60-223b-4894-8dd8-5878423e3e20 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:41.206740 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d60a0a60-223b-4894-8dd8-5878423e3e20 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:41.208342 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d60a0a60-223b-4894-8dd8-5878423e3e20 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:41.209636 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d60a0a60-223b-4894-8dd8-5878423e3e20 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1407 microversion: 2.20 time: 0.183244 Jul 14 14:36:41.210246 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 340/667] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:41 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:41.905098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d3900cf0-b8c9-4f9b-8d4c-f77ee3086ac7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d087ce4e-b978-4087-94f2-8d24bb357836"}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:41.907026 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-d3900cf0-b8c9-4f9b-8d4c-f77ee3086ac7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:41.914786 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d3900cf0-b8c9-4f9b-8d4c-f77ee3086ac7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:41.915232 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d3900cf0-b8c9-4f9b-8d4c-f77ee3086ac7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:41.916442 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d3900cf0-b8c9-4f9b-8d4c-f77ee3086ac7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:41.917208 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d3900cf0-b8c9-4f9b-8d4c-f77ee3086ac7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:42.231843 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-db67b264-307b-46ae-a3ad-adbd620048cf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:42.232432 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-db67b264-307b-46ae-a3ad-adbd620048cf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:42.238776 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-db67b264-307b-46ae-a3ad-adbd620048cf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:42.239372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-db67b264-307b-46ae-a3ad-adbd620048cf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:42.240190 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-db67b264-307b-46ae-a3ad-adbd620048cf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:42.240762 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-db67b264-307b-46ae-a3ad-adbd620048cf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:42.394680 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-db67b264-307b-46ae-a3ad-adbd620048cf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:42.403282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-db67b264-307b-46ae-a3ad-adbd620048cf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:42.404942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-db67b264-307b-46ae-a3ad-adbd620048cf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:42.406282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-db67b264-307b-46ae-a3ad-adbd620048cf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1407 microversion: 2.20 time: 0.179438 Jul 14 14:36:42.406857 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 341/668] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:42 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:36:42.892709 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-d3900cf0-b8c9-4f9b-8d4c-f77ee3086ac7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "POST /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.995888 Jul 14 14:36:42.893606 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 328/669] 10.222.0.93 () {60 vars in 1322 bytes} [Thu Jul 14 14:36:41 2022] POST /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments => generated 194 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:43.425101 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-3b5ed3c7-8530-442f-8a73-16975d3aad02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:43.426019 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-3b5ed3c7-8530-442f-8a73-16975d3aad02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:43.432492 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b5ed3c7-8530-442f-8a73-16975d3aad02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.432951 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b5ed3c7-8530-442f-8a73-16975d3aad02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:43.433966 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b5ed3c7-8530-442f-8a73-16975d3aad02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.434394 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b5ed3c7-8530-442f-8a73-16975d3aad02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:43.605802 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3b5ed3c7-8530-442f-8a73-16975d3aad02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:43.615864 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3b5ed3c7-8530-442f-8a73-16975d3aad02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:43.617525 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3b5ed3c7-8530-442f-8a73-16975d3aad02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:43.619143 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-3b5ed3c7-8530-442f-8a73-16975d3aad02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1600 microversion: 2.20 time: 0.198139 Jul 14 14:36:43.620087 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 342/670] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:43 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1600 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:43.637961 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-936952d3-bfe4-4dac-8d06-64abadb11704 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:43.638551 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-936952d3-bfe4-4dac-8d06-64abadb11704 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:43.645864 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-936952d3-bfe4-4dac-8d06-64abadb11704 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.646318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-936952d3-bfe4-4dac-8d06-64abadb11704 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:43.647096 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-936952d3-bfe4-4dac-8d06-64abadb11704 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.647533 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-936952d3-bfe4-4dac-8d06-64abadb11704 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:43.740428 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-936952d3-bfe4-4dac-8d06-64abadb11704 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.106812 Jul 14 14:36:43.741418 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 329/671] 10.222.0.93 () {60 vars in 1315 bytes} [Thu Jul 14 14:36:43 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:36:45.097002 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-425ced94-5efd-4c06-b16e-ab371e610fc4 req-293b939d-f9f0-4f07-8392-fe359c40b696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d810a21-86d3-4d18-b9d6-eae39990ac26", "tag": "56e9cb11-f5b0-4131-82d8-c97417b17d2c"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:45.106043 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-425ced94-5efd-4c06-b16e-ab371e610fc4 req-293b939d-f9f0-4f07-8392-fe359c40b696 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:45.106746 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-425ced94-5efd-4c06-b16e-ab371e610fc4 req-293b939d-f9f0-4f07-8392-fe359c40b696 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:45.120094 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-425ced94-5efd-4c06-b16e-ab371e610fc4 req-293b939d-f9f0-4f07-8392-fe359c40b696 service nova] Creating event network-changed:56e9cb11-f5b0-4131-82d8-c97417b17d2c for instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 on hv-cinder-79987 Jul 14 14:36:45.127455 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-425ced94-5efd-4c06-b16e-ab371e610fc4 req-293b939d-f9f0-4f07-8392-fe359c40b696 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035222 Jul 14 14:36:45.128235 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 343/672] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:51.536743 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-2e5ba4c8-ab29-48c4-bf30-5b32cbb00d23 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:51.538504 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-2e5ba4c8-ab29-48c4-bf30-5b32cbb00d23 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:51.546853 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2e5ba4c8-ab29-48c4-bf30-5b32cbb00d23 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:51.547350 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2e5ba4c8-ab29-48c4-bf30-5b32cbb00d23 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:51.548069 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2e5ba4c8-ab29-48c4-bf30-5b32cbb00d23 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:51.548683 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2e5ba4c8-ab29-48c4-bf30-5b32cbb00d23 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:51.584042 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-2e5ba4c8-ab29-48c4-bf30-5b32cbb00d23 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051223 Jul 14 14:36:51.586126 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 330/673] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:36:51 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:51.595920 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ebad0425-0a38-478d-a88a-12b937fbd9ee tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:51.596763 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-ebad0425-0a38-478d-a88a-12b937fbd9ee tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:51.603841 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=60 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:51.606847 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ebad0425-0a38-478d-a88a-12b937fbd9ee tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:51.607238 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ebad0425-0a38-478d-a88a-12b937fbd9ee tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:51.608014 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ebad0425-0a38-478d-a88a-12b937fbd9ee tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:51.608647 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ebad0425-0a38-478d-a88a-12b937fbd9ee tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:51.642955 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-ebad0425-0a38-478d-a88a-12b937fbd9ee tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments/d087ce4e-b978-4087-94f2-8d24bb357836" status: 200 len: 194 microversion: 2.1 time: 0.052092 Jul 14 14:36:51.643559 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 344/674] 10.222.0.93 () {58 vars in 1412 bytes} [Thu Jul 14 14:36:51 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments/d087ce4e-b978-4087-94f2-8d24bb357836 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:53.343044 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-28f6ec1e-58a0-4aa0-b9ea-13ff3624b3d9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9b90ebe-fe85-4e00-a9bc-5f2e589faa33"}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:53.344143 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-28f6ec1e-58a0-4aa0-b9ea-13ff3624b3d9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:53.351216 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-28f6ec1e-58a0-4aa0-b9ea-13ff3624b3d9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:53.351674 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-28f6ec1e-58a0-4aa0-b9ea-13ff3624b3d9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:53.352468 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-28f6ec1e-58a0-4aa0-b9ea-13ff3624b3d9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:53.352908 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-28f6ec1e-58a0-4aa0-b9ea-13ff3624b3d9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:54.247610 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-28f6ec1e-58a0-4aa0-b9ea-13ff3624b3d9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "POST /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.908296 Jul 14 14:36:54.248138 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 331/675] 10.222.0.93 () {60 vars in 1322 bytes} [Thu Jul 14 14:36:53 2022] POST /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments => generated 194 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:02.788214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-20a6134a-579e-425e-953f-cde112bad6f9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:02.789166 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-20a6134a-579e-425e-953f-cde112bad6f9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:02.792104 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=42 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:02.797012 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-20a6134a-579e-425e-953f-cde112bad6f9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:02.797461 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-20a6134a-579e-425e-953f-cde112bad6f9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:02.798262 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-20a6134a-579e-425e-953f-cde112bad6f9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:02.798696 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-20a6134a-579e-425e-953f-cde112bad6f9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:02.829017 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-20a6134a-579e-425e-953f-cde112bad6f9 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044663 Jul 14 14:37:02.829582 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 345/676] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:37:02 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:02.932238 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-02c57787-0cbe-4a51-a9df-581297b71399 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:02.932800 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-02c57787-0cbe-4a51-a9df-581297b71399 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:02.939063 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-02c57787-0cbe-4a51-a9df-581297b71399 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:02.939514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-02c57787-0cbe-4a51-a9df-581297b71399 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:02.940277 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-02c57787-0cbe-4a51-a9df-581297b71399 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:02.940711 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-02c57787-0cbe-4a51-a9df-581297b71399 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:02.969470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-02c57787-0cbe-4a51-a9df-581297b71399 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments/d087ce4e-b978-4087-94f2-8d24bb357836" status: 200 len: 194 microversion: 2.1 time: 0.042831 Jul 14 14:37:02.970078 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 332/677] 10.222.0.93 () {58 vars in 1412 bytes} [Thu Jul 14 14:37:02 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments/d087ce4e-b978-4087-94f2-8d24bb357836 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:02.987061 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-8e27cde7-aa39-43d0-9c26-424d3e6915e6 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:02.987540 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-8e27cde7-aa39-43d0-9c26-424d3e6915e6 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:02.994703 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8e27cde7-aa39-43d0-9c26-424d3e6915e6 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:02.995138 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8e27cde7-aa39-43d0-9c26-424d3e6915e6 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:02.995915 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8e27cde7-aa39-43d0-9c26-424d3e6915e6 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:02.996344 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8e27cde7-aa39-43d0-9c26-424d3e6915e6 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:03.078811 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.objects.instance [None req-8e27cde7-aa39-43d0-9c26-424d3e6915e6 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lazy-loading 'services' on Instance uuid 911572ab-0885-4187-b3f7-4a62f1848c1d {{(pid=118461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:37:03.333745 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-8e27cde7-aa39-43d0-9c26-424d3e6915e6 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "DELETE /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments/d087ce4e-b978-4087-94f2-8d24bb357836" status: 202 len: 0 microversion: 2.1 time: 0.350431 Jul 14 14:37:03.334436 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 346/678] 10.222.0.93 () {58 vars in 1415 bytes} [Thu Jul 14 14:37:02 2022] DELETE /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments/d087ce4e-b978-4087-94f2-8d24bb357836 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:37:05.498642 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d6f459fd-9502-422c-a339-cb1a10f7c03f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:05.498642 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-d6f459fd-9502-422c-a339-cb1a10f7c03f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:05.509486 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d6f459fd-9502-422c-a339-cb1a10f7c03f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:05.510306 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d6f459fd-9502-422c-a339-cb1a10f7c03f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:05.511664 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d6f459fd-9502-422c-a339-cb1a10f7c03f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:05.512456 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d6f459fd-9502-422c-a339-cb1a10f7c03f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:05.545230 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-d6f459fd-9502-422c-a339-cb1a10f7c03f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments/e9b90ebe-fe85-4e00-a9bc-5f2e589faa33" status: 200 len: 194 microversion: 2.1 time: 0.052603 Jul 14 14:37:05.546042 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 333/679] 10.222.0.93 () {58 vars in 1412 bytes} [Thu Jul 14 14:37:05 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments/e9b90ebe-fe85-4e00-a9bc-5f2e589faa33 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:05.557755 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e3005bd7-e76b-4c67-8ce1-dbfede6b8386 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:05.558561 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e3005bd7-e76b-4c67-8ce1-dbfede6b8386 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:05.564886 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e3005bd7-e76b-4c67-8ce1-dbfede6b8386 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:05.565327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e3005bd7-e76b-4c67-8ce1-dbfede6b8386 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:05.566112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e3005bd7-e76b-4c67-8ce1-dbfede6b8386 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:05.566539 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e3005bd7-e76b-4c67-8ce1-dbfede6b8386 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:05.645032 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.objects.instance [None req-e3005bd7-e76b-4c67-8ce1-dbfede6b8386 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lazy-loading 'services' on Instance uuid 911572ab-0885-4187-b3f7-4a62f1848c1d {{(pid=118461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:37:05.950534 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e3005bd7-e76b-4c67-8ce1-dbfede6b8386 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "DELETE /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments/e9b90ebe-fe85-4e00-a9bc-5f2e589faa33" status: 202 len: 0 microversion: 2.1 time: 0.398589 Jul 14 14:37:05.951133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 347/680] 10.222.0.93 () {58 vars in 1415 bytes} [Thu Jul 14 14:37:05 2022] DELETE /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments/e9b90ebe-fe85-4e00-a9bc-5f2e589faa33 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:07.111683 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-aecf49e5-936d-4b43-a7a8-44d678264355 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:07.115864 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-aecf49e5-936d-4b43-a7a8-44d678264355 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:07.119139 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-aecf49e5-936d-4b43-a7a8-44d678264355 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:07.119582 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-aecf49e5-936d-4b43-a7a8-44d678264355 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:07.120341 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-aecf49e5-936d-4b43-a7a8-44d678264355 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:07.120771 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-aecf49e5-936d-4b43-a7a8-44d678264355 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:07.149287 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-aecf49e5-936d-4b43-a7a8-44d678264355 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041594 Jul 14 14:37:07.151608 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 334/681] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:37:07 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:37:07.256608 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d2ca4585-76b2-48bf-a4c0-307788be4e4f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:07.258395 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d2ca4585-76b2-48bf-a4c0-307788be4e4f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:07.264975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d2ca4585-76b2-48bf-a4c0-307788be4e4f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:07.265414 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d2ca4585-76b2-48bf-a4c0-307788be4e4f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:07.266225 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d2ca4585-76b2-48bf-a4c0-307788be4e4f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:07.266649 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d2ca4585-76b2-48bf-a4c0-307788be4e4f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:07.294824 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d2ca4585-76b2-48bf-a4c0-307788be4e4f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042932 Jul 14 14:37:07.295601 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 348/682] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:37:07 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:37:07.351750 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0af14445-5349-4f7d-aea4-c590fac65d3d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:07.352243 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0af14445-5349-4f7d-aea4-c590fac65d3d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:07.358457 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0af14445-5349-4f7d-aea4-c590fac65d3d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:07.358902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0af14445-5349-4f7d-aea4-c590fac65d3d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:07.359662 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0af14445-5349-4f7d-aea4-c590fac65d3d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:07.360098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0af14445-5349-4f7d-aea4-c590fac65d3d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:07.385074 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0af14445-5349-4f7d-aea4-c590fac65d3d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Going to try to terminate instance {{(pid=118462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:37:07.785787 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0af14445-5349-4f7d-aea4-c590fac65d3d tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "DELETE /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 204 len: 0 microversion: 2.1 time: 0.437554 Jul 14 14:37:07.786407 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 335/683] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:37:07 2022] DELETE /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:37:07.795173 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-841cb8ec-c80f-477a-b6eb-a95c5f635d7b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:07.795830 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-841cb8ec-c80f-477a-b6eb-a95c5f635d7b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:07.801807 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-841cb8ec-c80f-477a-b6eb-a95c5f635d7b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:07.802245 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-841cb8ec-c80f-477a-b6eb-a95c5f635d7b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:07.802998 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-841cb8ec-c80f-477a-b6eb-a95c5f635d7b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:07.803423 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-841cb8ec-c80f-477a-b6eb-a95c5f635d7b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:07.948702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-841cb8ec-c80f-477a-b6eb-a95c5f635d7b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:07.956251 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-841cb8ec-c80f-477a-b6eb-a95c5f635d7b tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1673 microversion: 2.1 time: 0.164886 Jul 14 14:37:07.956815 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 349/684] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:07 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:08.973638 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-234f223a-877c-4b4c-8087-f0f29b865d58 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:08.977461 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-234f223a-877c-4b4c-8087-f0f29b865d58 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:08.981821 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-234f223a-877c-4b4c-8087-f0f29b865d58 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:08.982266 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-234f223a-877c-4b4c-8087-f0f29b865d58 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:08.983038 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-234f223a-877c-4b4c-8087-f0f29b865d58 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:08.983468 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-234f223a-877c-4b4c-8087-f0f29b865d58 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:09.112499 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-234f223a-877c-4b4c-8087-f0f29b865d58 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:09.119917 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-234f223a-877c-4b4c-8087-f0f29b865d58 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1673 microversion: 2.1 time: 0.150599 Jul 14 14:37:09.120510 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 336/685] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:08 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:10.137071 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-979479fd-1c33-400b-b027-fae20b6c4535 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:10.137682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-979479fd-1c33-400b-b027-fae20b6c4535 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:10.144373 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-979479fd-1c33-400b-b027-fae20b6c4535 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:10.144817 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-979479fd-1c33-400b-b027-fae20b6c4535 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:10.145579 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-979479fd-1c33-400b-b027-fae20b6c4535 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:10.146047 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-979479fd-1c33-400b-b027-fae20b6c4535 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:10.278283 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-979479fd-1c33-400b-b027-fae20b6c4535 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:10.285601 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-979479fd-1c33-400b-b027-fae20b6c4535 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1673 microversion: 2.1 time: 0.152949 Jul 14 14:37:10.286185 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 350/686] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:10 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:10.598156 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-a5f09bea-576c-4b45-8fa5-83957b06d96e req-5d1a2e1f-5054-4647-a0ec-765cab0db1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911572ab-0885-4187-b3f7-4a62f1848c1d", "name": "network-vif-deleted", "tag": "1036eb7e-e728-484f-95a0-13ba697cc1cc"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:10.606723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-a5f09bea-576c-4b45-8fa5-83957b06d96e req-5d1a2e1f-5054-4647-a0ec-765cab0db1c3 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:10.617578 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-a5f09bea-576c-4b45-8fa5-83957b06d96e req-5d1a2e1f-5054-4647-a0ec-765cab0db1c3 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:10.618741 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-a5f09bea-576c-4b45-8fa5-83957b06d96e req-5d1a2e1f-5054-4647-a0ec-765cab0db1c3 service nova] Creating event network-vif-deleted:1036eb7e-e728-484f-95a0-13ba697cc1cc for instance 911572ab-0885-4187-b3f7-4a62f1848c1d on hv-cinder-79987 Jul 14 14:37:10.623644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-a5f09bea-576c-4b45-8fa5-83957b06d96e req-5d1a2e1f-5054-4647-a0ec-765cab0db1c3 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029636 Jul 14 14:37:10.624226 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 337/687] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:11.303041 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-bfcbf9e4-aeaf-4b45-a1bb-bc4a6b2a0e16 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:11.303803 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-bfcbf9e4-aeaf-4b45-a1bb-bc4a6b2a0e16 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:11.311055 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bfcbf9e4-aeaf-4b45-a1bb-bc4a6b2a0e16 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:11.311688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bfcbf9e4-aeaf-4b45-a1bb-bc4a6b2a0e16 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:11.312459 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bfcbf9e4-aeaf-4b45-a1bb-bc4a6b2a0e16 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:11.312950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bfcbf9e4-aeaf-4b45-a1bb-bc4a6b2a0e16 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:11.346330 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bfcbf9e4-aeaf-4b45-a1bb-bc4a6b2a0e16 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:11.346794 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bfcbf9e4-aeaf-4b45-a1bb-bc4a6b2a0e16 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:11.347214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.objects.instance [None req-bfcbf9e4-aeaf-4b45-a1bb-bc4a6b2a0e16 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lazy-loading 'fault' on Instance uuid 911572ab-0885-4187-b3f7-4a62f1848c1d {{(pid=118461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:37:11.413529 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-bfcbf9e4-aeaf-4b45-a1bb-bc4a6b2a0e16 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc26c3a3096b4b318d18d4c919f7a60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f707e1171364031b016d16a10efda78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:11.413529 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-bfcbf9e4-aeaf-4b45-a1bb-bc4a6b2a0e16 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 200 len: 1327 microversion: 2.1 time: 0.103844 Jul 14 14:37:11.413529 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 351/688] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:11 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:12.421469 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-debd7583-27bb-4610-be57-6832143be3a2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:12.422095 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-debd7583-27bb-4610-be57-6832143be3a2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:12.428247 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-debd7583-27bb-4610-be57-6832143be3a2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:12.428688 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-debd7583-27bb-4610-be57-6832143be3a2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:12.429438 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-debd7583-27bb-4610-be57-6832143be3a2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:12.429915 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-debd7583-27bb-4610-be57-6832143be3a2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:12.433050 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:12.443994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-debd7583-27bb-4610-be57-6832143be3a2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] HTTP exception thrown: Instance 911572ab-0885-4187-b3f7-4a62f1848c1d could not be found. Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-debd7583-27bb-4610-be57-6832143be3a2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Request method failure captured: Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d HTTP/1.1 Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0CiejYvQdm7CioGAfmFaY1tyNTzC-wiwt50-f7zbngkLYS_MC6u-RdS_msB2Ocbhg_7Y8HNAehAdTHtVrXgXGUo8Wyp2mKxTrhzydp1SjehMS1c7DQxhMp3qiqGfSyfHQ9tfFUwxrzfoRKtITeMjfGO5rSmzTM1YPtLlX3gZvYj03FQ Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: 9f707e1171364031b016d16a10efda78 Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-AttachVolumeTestJSON-277404979 Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:37:12.446374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:37:12.448982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9f707e1171364031b016d16a10efda78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9f707e1171364031b016d16a10efda78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9f707e1171364031b016d16a10efda78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9f707e1171364031b016d16a10efda78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:37:12.448982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-AttachVolumeTestJSON-277404979 Jul 14 14:37:12.448982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: 9f707e1171364031b016d16a10efda78 Jul 14 14:37:12.448982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-AttachVolumeTestJSON-277404979 Jul 14 14:37:12.448982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-AttachVolumeTestJSON-277404979-project Jul 14 14:37:12.448982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:37:12.448982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:37:12.448982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: bc26c3a3096b4b318d18d4c919f7a60a Jul 14 14:37:12.448982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-AttachVolumeTestJSON-277404979-project Jul 14 14:37:12.448982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:37:12.448982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 911572ab-0885-4187-b3f7-4a62f1848c1d could not be found. Jul 14 14:37:12.448982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '911572ab-0885-4187-b3f7-4a62f1848c1d'} Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 911572ab-0885-4187-b3f7-4a62f1848c1d could not be found. Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:12.450292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:12.452155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:12.452155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:37:12.452155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:12.452155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:37:12.452155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:12.452155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:12.452155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:12.452155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 911572ab-0885-4187-b3f7-4a62f1848c1d could not be found. Jul 14 14:37:12.452155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:12.452155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:12.452155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:12.452155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:12.452155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:12.452155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:12.452155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:12.452155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:12.452155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 911572ab-0885-4187-b3f7-4a62f1848c1d could not be found. Jul 14 14:37:12.452155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:12.453486 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-debd7583-27bb-4610-be57-6832143be3a2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Returning 404 to user: Instance 911572ab-0885-4187-b3f7-4a62f1848c1d could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:12.453486 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-debd7583-27bb-4610-be57-6832143be3a2 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 404 len: 111 microversion: 2.1 time: 0.030339 Jul 14 14:37:12.453486 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 338/689] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:12 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:12.455868 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f4d6df24-8393-4110-9bd7-3ae2bf0cfdf7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '.version_select at 0x7f415fb8cca0>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:12.531155 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-f4d6df24-8393-4110-9bd7-3ae2bf0cfdf7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660765399" status: 202 len: 0 microversion: 2.1 time: 0.079081 Jul 14 14:37:12.532448 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 352/690] 10.222.0.93 () {58 vars in 1220 bytes} [Thu Jul 14 14:37:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660765399 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:15.995091 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e5362f55-f2bc-470c-9bd7-9ed1debcfc0f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:15.995585 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e5362f55-f2bc-470c-9bd7-9ed1debcfc0f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:16.002454 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e5362f55-f2bc-470c-9bd7-9ed1debcfc0f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:16.002898 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e5362f55-f2bc-470c-9bd7-9ed1debcfc0f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:16.003655 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e5362f55-f2bc-470c-9bd7-9ed1debcfc0f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:16.004089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e5362f55-f2bc-470c-9bd7-9ed1debcfc0f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:16.018217 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-e5362f55-f2bc-470c-9bd7-9ed1debcfc0f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] HTTP exception thrown: Instance 911572ab-0885-4187-b3f7-4a62f1848c1d could not be found. Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e5362f55-f2bc-470c-9bd7-9ed1debcfc0f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Request method failure captured: Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: DELETE /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d HTTP/1.1 Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0CiejYvQdm7CioGAfmFaY1tyNTzC-wiwt50-f7zbngkLYS_MC6u-RdS_msB2Ocbhg_7Y8HNAehAdTHtVrXgXGUo8Wyp2mKxTrhzydp1SjehMS1c7DQxhMp3qiqGfSyfHQ9tfFUwxrzfoRKtITeMjfGO5rSmzTM1YPtLlX3gZvYj03FQ Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: 9f707e1171364031b016d16a10efda78 Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-AttachVolumeTestJSON-277404979 Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:37:16.019762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:37:16.021318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9f707e1171364031b016d16a10efda78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9f707e1171364031b016d16a10efda78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9f707e1171364031b016d16a10efda78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9f707e1171364031b016d16a10efda78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:37:16.021318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-AttachVolumeTestJSON-277404979 Jul 14 14:37:16.021318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: 9f707e1171364031b016d16a10efda78 Jul 14 14:37:16.021318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-AttachVolumeTestJSON-277404979 Jul 14 14:37:16.021318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-AttachVolumeTestJSON-277404979-project Jul 14 14:37:16.021318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:37:16.021318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:37:16.021318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: bc26c3a3096b4b318d18d4c919f7a60a Jul 14 14:37:16.021318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-AttachVolumeTestJSON-277404979-project Jul 14 14:37:16.021318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:37:16.021318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 911572ab-0885-4187-b3f7-4a62f1848c1d could not be found. Jul 14 14:37:16.021318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '911572ab-0885-4187-b3f7-4a62f1848c1d'} Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 911572ab-0885-4187-b3f7-4a62f1848c1d could not be found. Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:16.022475 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 911572ab-0885-4187-b3f7-4a62f1848c1d could not be found. Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 911572ab-0885-4187-b3f7-4a62f1848c1d could not be found. Jul 14 14:37:16.023851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:16.026058 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e5362f55-f2bc-470c-9bd7-9ed1debcfc0f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Returning 404 to user: Instance 911572ab-0885-4187-b3f7-4a62f1848c1d could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:16.026058 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e5362f55-f2bc-470c-9bd7-9ed1debcfc0f tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "DELETE /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 404 len: 111 microversion: 2.1 time: 0.030321 Jul 14 14:37:16.026058 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 339/691] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:37:15 2022] DELETE /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:16.030806 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-38b740c4-cd4c-49c3-afdc-7a6204e084a7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:16.031419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-38b740c4-cd4c-49c3-afdc-7a6204e084a7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 911572ab-0885-4187-b3f7-4a62f1848c1d] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:16.038051 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-38b740c4-cd4c-49c3-afdc-7a6204e084a7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:16.038500 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-38b740c4-cd4c-49c3-afdc-7a6204e084a7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:16.039253 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-38b740c4-cd4c-49c3-afdc-7a6204e084a7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:16.039688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-38b740c4-cd4c-49c3-afdc-7a6204e084a7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:16.052555 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-38b740c4-cd4c-49c3-afdc-7a6204e084a7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] HTTP exception thrown: Instance 911572ab-0885-4187-b3f7-4a62f1848c1d could not be found. Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-38b740c4-cd4c-49c3-afdc-7a6204e084a7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Request method failure captured: Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d HTTP/1.1 Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0CiejYvQdm7CioGAfmFaY1tyNTzC-wiwt50-f7zbngkLYS_MC6u-RdS_msB2Ocbhg_7Y8HNAehAdTHtVrXgXGUo8Wyp2mKxTrhzydp1SjehMS1c7DQxhMp3qiqGfSyfHQ9tfFUwxrzfoRKtITeMjfGO5rSmzTM1YPtLlX3gZvYj03FQ Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: 9f707e1171364031b016d16a10efda78 Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-AttachVolumeTestJSON-277404979 Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:37:16.054189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:37:16.055702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9f707e1171364031b016d16a10efda78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9f707e1171364031b016d16a10efda78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9f707e1171364031b016d16a10efda78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9f707e1171364031b016d16a10efda78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:37:16.055702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-AttachVolumeTestJSON-277404979 Jul 14 14:37:16.055702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: 9f707e1171364031b016d16a10efda78 Jul 14 14:37:16.055702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-AttachVolumeTestJSON-277404979 Jul 14 14:37:16.055702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-AttachVolumeTestJSON-277404979-project Jul 14 14:37:16.055702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:37:16.055702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:37:16.055702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: bc26c3a3096b4b318d18d4c919f7a60a Jul 14 14:37:16.055702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-AttachVolumeTestJSON-277404979-project Jul 14 14:37:16.055702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:37:16.055702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Instance 911572ab-0885-4187-b3f7-4a62f1848c1d could not be found. Jul 14 14:37:16.055702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': '911572ab-0885-4187-b3f7-4a62f1848c1d'} Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 911572ab-0885-4187-b3f7-4a62f1848c1d could not be found. Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:16.056671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:16.058009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:16.058009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:37:16.058009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:16.058009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:37:16.058009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:16.058009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:16.058009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:16.058009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 911572ab-0885-4187-b3f7-4a62f1848c1d could not be found. Jul 14 14:37:16.058009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:37:16.058009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:16.058009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:37:16.058009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:16.058009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:16.058009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:16.058009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:16.058009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:16.058009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 911572ab-0885-4187-b3f7-4a62f1848c1d could not be found. Jul 14 14:37:16.058009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:37:16.059184 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-38b740c4-cd4c-49c3-afdc-7a6204e084a7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Returning 404 to user: Instance 911572ab-0885-4187-b3f7-4a62f1848c1d could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:16.059184 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-38b740c4-cd4c-49c3-afdc-7a6204e084a7 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d" status: 404 len: 111 microversion: 2.1 time: 0.029246 Jul 14 14:37:16.059184 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 353/692] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:16 2022] GET /compute/v2.1/servers/911572ab-0885-4187-b3f7-4a62f1848c1d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:17.296354 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e43c8aaf-4d7d-425f-b561-2174bc1f1ef5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:17.296854 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e43c8aaf-4d7d-425f-b561-2174bc1f1ef5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:17.303964 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e43c8aaf-4d7d-425f-b561-2174bc1f1ef5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:17.304448 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e43c8aaf-4d7d-425f-b561-2174bc1f1ef5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:17.305156 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e43c8aaf-4d7d-425f-b561-2174bc1f1ef5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:17.305586 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e43c8aaf-4d7d-425f-b561-2174bc1f1ef5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:17.318726 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-e43c8aaf-4d7d-425f-b561-2174bc1f1ef5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] HTTP exception thrown: Instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 could not be found. Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e43c8aaf-4d7d-425f-b561-2174bc1f1ef5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Request method failure captured: Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: DELETE /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 HTTP/1.1 Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0CiejYvQdm7CioGAfmFaY1tyNTzC-wiwt50-f7zbngkLYS_MC6u-RdS_msB2Ocbhg_7Y8HNAehAdTHtVrXgXGUo8Wyp2mKxTrhzydp1SjehMS1c7DQxhMp3qiqGfSyfHQ9tfFUwxrzfoRKtITeMjfGO5rSmzTM1YPtLlX3gZvYj03FQ Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: 9f707e1171364031b016d16a10efda78 Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-AttachVolumeTestJSON-277404979 Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:37:17.320227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:37:17.321821 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9f707e1171364031b016d16a10efda78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9f707e1171364031b016d16a10efda78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9f707e1171364031b016d16a10efda78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9f707e1171364031b016d16a10efda78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:37:17.321821 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-AttachVolumeTestJSON-277404979 Jul 14 14:37:17.321821 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: 9f707e1171364031b016d16a10efda78 Jul 14 14:37:17.321821 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-AttachVolumeTestJSON-277404979 Jul 14 14:37:17.321821 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-AttachVolumeTestJSON-277404979-project Jul 14 14:37:17.321821 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:37:17.321821 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:37:17.321821 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: bc26c3a3096b4b318d18d4c919f7a60a Jul 14 14:37:17.321821 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-AttachVolumeTestJSON-277404979-project Jul 14 14:37:17.321821 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:37:17.321821 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 could not be found. Jul 14 14:37:17.321821 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '43e8bc61-9b48-4f75-b6cf-c0c05b28aad0'} Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 could not be found. Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:17.322632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 could not be found. Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 could not be found. Jul 14 14:37:17.324027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:17.325635 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e43c8aaf-4d7d-425f-b561-2174bc1f1ef5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Returning 404 to user: Instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:17.325635 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e43c8aaf-4d7d-425f-b561-2174bc1f1ef5 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "DELETE /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 404 len: 111 microversion: 2.1 time: 0.029051 Jul 14 14:37:17.325635 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 340/693] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:37:17 2022] DELETE /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:17.329966 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ffcfec35-dcd2-4d6a-aca8-3db813a8a078 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:17.330644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-ffcfec35-dcd2-4d6a-aca8-3db813a8a078 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] [instance: 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:17.337639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ffcfec35-dcd2-4d6a-aca8-3db813a8a078 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:17.338125 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ffcfec35-dcd2-4d6a-aca8-3db813a8a078 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:17.338884 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ffcfec35-dcd2-4d6a-aca8-3db813a8a078 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:17.339317 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ffcfec35-dcd2-4d6a-aca8-3db813a8a078 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:17.352301 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-ffcfec35-dcd2-4d6a-aca8-3db813a8a078 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] HTTP exception thrown: Instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 could not be found. Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ffcfec35-dcd2-4d6a-aca8-3db813a8a078 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Request method failure captured: Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 HTTP/1.1 Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0CiejYvQdm7CioGAfmFaY1tyNTzC-wiwt50-f7zbngkLYS_MC6u-RdS_msB2Ocbhg_7Y8HNAehAdTHtVrXgXGUo8Wyp2mKxTrhzydp1SjehMS1c7DQxhMp3qiqGfSyfHQ9tfFUwxrzfoRKtITeMjfGO5rSmzTM1YPtLlX3gZvYj03FQ Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: 9f707e1171364031b016d16a10efda78 Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-AttachVolumeTestJSON-277404979 Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:37:17.354383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:37:17.356022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_9f707e1171364031b016d16a10efda78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9f707e1171364031b016d16a10efda78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/9f707e1171364031b016d16a10efda78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/9f707e1171364031b016d16a10efda78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:37:17.356022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-AttachVolumeTestJSON-277404979 Jul 14 14:37:17.356022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: 9f707e1171364031b016d16a10efda78 Jul 14 14:37:17.356022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-AttachVolumeTestJSON-277404979 Jul 14 14:37:17.356022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-AttachVolumeTestJSON-277404979-project Jul 14 14:37:17.356022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:37:17.356022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:37:17.356022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: bc26c3a3096b4b318d18d4c919f7a60a Jul 14 14:37:17.356022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-AttachVolumeTestJSON-277404979-project Jul 14 14:37:17.356022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:37:17.356022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 could not be found. Jul 14 14:37:17.356022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': '43e8bc61-9b48-4f75-b6cf-c0c05b28aad0'} Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 could not be found. Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:17.356765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:17.357970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:17.357970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:37:17.357970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:17.357970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:37:17.357970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:17.357970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:17.357970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:17.357970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 could not be found. Jul 14 14:37:17.357970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:37:17.357970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:17.357970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:37:17.357970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:17.357970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:17.357970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:17.357970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:17.357970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:17.357970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 could not be found. Jul 14 14:37:17.357970 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:37:17.359027 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ffcfec35-dcd2-4d6a-aca8-3db813a8a078 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] Returning 404 to user: Instance 43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:17.359027 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-ffcfec35-dcd2-4d6a-aca8-3db813a8a078 tempest-AttachVolumeTestJSON-277404979 tempest-AttachVolumeTestJSON-277404979-project] 10.222.0.93 "GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0" status: 404 len: 111 microversion: 2.1 time: 0.029939 Jul 14 14:37:17.359027 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 354/694] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:17 2022] GET /compute/v2.1/servers/43e8bc61-9b48-4f75-b6cf-c0c05b28aad0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:21.359924 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-5dd50bfc-8dbd-49cb-803f-098c9a354898 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:21.360492 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-5dd50bfc-8dbd-49cb-803f-098c9a354898 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:21.366941 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5dd50bfc-8dbd-49cb-803f-098c9a354898 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:21.367390 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5dd50bfc-8dbd-49cb-803f-098c9a354898 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:21.368175 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5dd50bfc-8dbd-49cb-803f-098c9a354898 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:21.368610 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5dd50bfc-8dbd-49cb-803f-098c9a354898 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:21.391897 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-5dd50bfc-8dbd-49cb-803f-098c9a354898 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/ips" status: 200 len: 153 microversion: 2.20 time: 0.036282 Jul 14 14:37:21.393474 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 341/695] 10.222.0.93 () {60 vars in 1288 bytes} [Thu Jul 14 14:37:21 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:37:23.703693 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-fb403e53-3ee4-4d17-9dc2-b53d117355a4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:23.705461 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-fb403e53-3ee4-4d17-9dc2-b53d117355a4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:23.712547 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fb403e53-3ee4-4d17-9dc2-b53d117355a4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:23.712997 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fb403e53-3ee4-4d17-9dc2-b53d117355a4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:23.713805 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fb403e53-3ee4-4d17-9dc2-b53d117355a4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:23.714355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fb403e53-3ee4-4d17-9dc2-b53d117355a4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:23.745078 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.objects.instance [None req-fb403e53-3ee4-4d17-9dc2-b53d117355a4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lazy-loading 'flavor' on Instance uuid 9d810a21-86d3-4d18-b9d6-eae39990ac26 {{(pid=118461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:37:24.324751 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-fb403e53-3ee4-4d17-9dc2-b53d117355a4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "POST /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/action" status: 202 len: 0 microversion: 2.20 time: 0.625829 Jul 14 14:37:24.325592 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 355/696] 10.222.0.93 () {62 vars in 1318 bytes} [Thu Jul 14 14:37:23 2022] POST /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/action => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:37:24.335340 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e4b090f3-4ded-4e1e-a7b7-24db105a36b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:24.335784 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e4b090f3-4ded-4e1e-a7b7-24db105a36b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:24.341891 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:24.343788 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e4b090f3-4ded-4e1e-a7b7-24db105a36b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:24.344219 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e4b090f3-4ded-4e1e-a7b7-24db105a36b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:24.345175 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e4b090f3-4ded-4e1e-a7b7-24db105a36b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:24.345594 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e4b090f3-4ded-4e1e-a7b7-24db105a36b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:24.530564 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e4b090f3-4ded-4e1e-a7b7-24db105a36b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:24.538632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e4b090f3-4ded-4e1e-a7b7-24db105a36b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:24.542017 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e4b090f3-4ded-4e1e-a7b7-24db105a36b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:24.542017 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e4b090f3-4ded-4e1e-a7b7-24db105a36b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1725 microversion: 2.20 time: 0.210654 Jul 14 14:37:24.542017 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 342/697] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:24 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:25.561108 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-5f26eaff-9043-4a3c-8bb7-8725672c44a8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:25.561823 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-5f26eaff-9043-4a3c-8bb7-8725672c44a8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:25.572559 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5f26eaff-9043-4a3c-8bb7-8725672c44a8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:25.575763 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5f26eaff-9043-4a3c-8bb7-8725672c44a8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:25.575763 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5f26eaff-9043-4a3c-8bb7-8725672c44a8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:25.575763 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5f26eaff-9043-4a3c-8bb7-8725672c44a8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:25.851552 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5f26eaff-9043-4a3c-8bb7-8725672c44a8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:25.861920 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5f26eaff-9043-4a3c-8bb7-8725672c44a8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:25.863963 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5f26eaff-9043-4a3c-8bb7-8725672c44a8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:25.865524 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-5f26eaff-9043-4a3c-8bb7-8725672c44a8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1725 microversion: 2.20 time: 0.309386 Jul 14 14:37:25.869821 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 356/698] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:25 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1725 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:26.883922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-5352f48c-6f17-45f6-923f-ceaa90061cc1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:26.884470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-5352f48c-6f17-45f6-923f-ceaa90061cc1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:26.892700 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5352f48c-6f17-45f6-923f-ceaa90061cc1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:26.893222 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5352f48c-6f17-45f6-923f-ceaa90061cc1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:26.894099 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5352f48c-6f17-45f6-923f-ceaa90061cc1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:26.894603 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5352f48c-6f17-45f6-923f-ceaa90061cc1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:27.126328 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-5352f48c-6f17-45f6-923f-ceaa90061cc1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:27.135694 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-5352f48c-6f17-45f6-923f-ceaa90061cc1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:27.138396 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-5352f48c-6f17-45f6-923f-ceaa90061cc1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:27.138574 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-5352f48c-6f17-45f6-923f-ceaa90061cc1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1725 microversion: 2.20 time: 0.258701 Jul 14 14:37:27.139141 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 343/699] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:26 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1725 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:28.156870 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-8c1dfc71-6189-45fb-af76-01b4d6e2cb5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:28.157488 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-8c1dfc71-6189-45fb-af76-01b4d6e2cb5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:28.164694 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8c1dfc71-6189-45fb-af76-01b4d6e2cb5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:28.165372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8c1dfc71-6189-45fb-af76-01b4d6e2cb5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:28.166229 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8c1dfc71-6189-45fb-af76-01b4d6e2cb5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:28.166856 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8c1dfc71-6189-45fb-af76-01b4d6e2cb5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:28.396247 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-8c1dfc71-6189-45fb-af76-01b4d6e2cb5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:28.405557 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-8c1dfc71-6189-45fb-af76-01b4d6e2cb5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:28.407229 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-8c1dfc71-6189-45fb-af76-01b4d6e2cb5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:28.408388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-8c1dfc71-6189-45fb-af76-01b4d6e2cb5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1725 microversion: 2.20 time: 0.255488 Jul 14 14:37:28.408939 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 357/700] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:28 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:28.875914 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-3176b5d8-c607-4484-901f-e9a9b89589a1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Action: 'create', calling method: .version_select at 0x7f416c4e53a0>, body: {"keypair": {"name": "tempest-keypair-1328268718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCP+FR9DE2f8E84dpezl8FoODAV3NtzPGmFfhEjjBA/eU0MFY5IYvuEtMO93179MGbqS2xSk8YydA/x7V6Kj3u2dB7nX9Th3yptAJL5GCrdKQbtDrt3VHpEUJfb1tgrhpw=="}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:28.887995 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-3176b5d8-c607-4484-901f-e9a9b89589a1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Getting quotas for project abb12869989f45cc875ecb36dd1f7aef. Resources: {'key_pairs'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:37:28.891806 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-3176b5d8-c607-4484-901f-e9a9b89589a1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Getting quotas for user 98f00ffeef484dd489ed67b96d1ed783 and project abb12869989f45cc875ecb36dd1f7aef. Resources: {'key_pairs'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:37:28.993794 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-3176b5d8-c607-4484-901f-e9a9b89589a1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.237320 Jul 14 14:37:28.997151 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 344/701] 10.222.0.93 () {60 vars in 1158 bytes} [Thu Jul 14 14:37:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:29.427187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-1766fee9-65f5-42be-9c61-34031c339d7a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:29.427770 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-1766fee9-65f5-42be-9c61-34031c339d7a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:29.435724 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1766fee9-65f5-42be-9c61-34031c339d7a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:29.436192 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1766fee9-65f5-42be-9c61-34031c339d7a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:29.436950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1766fee9-65f5-42be-9c61-34031c339d7a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:29.437369 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1766fee9-65f5-42be-9c61-34031c339d7a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:29.648689 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-1766fee9-65f5-42be-9c61-34031c339d7a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:29.656549 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-1766fee9-65f5-42be-9c61-34031c339d7a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:29.658334 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-1766fee9-65f5-42be-9c61-34031c339d7a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:29.659479 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-1766fee9-65f5-42be-9c61-34031c339d7a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1725 microversion: 2.20 time: 0.236232 Jul 14 14:37:29.660031 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 358/702] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:29 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:30.679095 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e10e814a-6d09-4caa-9838-513acdc10817 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:30.679712 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e10e814a-6d09-4caa-9838-513acdc10817 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:30.688045 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e10e814a-6d09-4caa-9838-513acdc10817 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:30.688489 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e10e814a-6d09-4caa-9838-513acdc10817 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:30.689393 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e10e814a-6d09-4caa-9838-513acdc10817 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:30.689927 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e10e814a-6d09-4caa-9838-513acdc10817 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:30.866641 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e10e814a-6d09-4caa-9838-513acdc10817 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:30.875462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e10e814a-6d09-4caa-9838-513acdc10817 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:30.876954 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e10e814a-6d09-4caa-9838-513acdc10817 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:30.878124 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e10e814a-6d09-4caa-9838-513acdc10817 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1725 microversion: 2.20 time: 0.203684 Jul 14 14:37:30.878675 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 345/703] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:30 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:37:31.701629 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ae4b289f-1add-4f82-933e-e73c45400762 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-196598476", "imageRef": "7ea875a4-facb-4053-be2d-ff0080d2f3a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e31486e8-2bc1-4f00-b9ce-bbd86c605e0f"}], "security_groups": [{"name": "tempest-securitygroup--1844439068"}], "key_name": "tempest-keypair-1328268718", "user_data": "}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:31.820121 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.network.neutron [None req-ae4b289f-1add-4f82-933e-e73c45400762 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] validate_networks() for [('e31486e8-2bc1-4f00-b9ce-bbd86c605e0f', None, None, None, None, None)] {{(pid=118461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:37:31.898941 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-73813e12-a7e1-4013-894f-0201f87c1718 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:31.899540 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-73813e12-a7e1-4013-894f-0201f87c1718 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:31.906280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-73813e12-a7e1-4013-894f-0201f87c1718 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:31.906941 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-73813e12-a7e1-4013-894f-0201f87c1718 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:31.907876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-73813e12-a7e1-4013-894f-0201f87c1718 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:31.908462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-73813e12-a7e1-4013-894f-0201f87c1718 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:32.105051 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-73813e12-a7e1-4013-894f-0201f87c1718 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:32.114660 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-73813e12-a7e1-4013-894f-0201f87c1718 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:32.116912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-73813e12-a7e1-4013-894f-0201f87c1718 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:32.118293 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-73813e12-a7e1-4013-894f-0201f87c1718 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1725 microversion: 2.20 time: 0.225849 Jul 14 14:37:32.118859 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 346/704] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:31 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:37:32.274925 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-ae4b289f-1add-4f82-933e-e73c45400762 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Flavor limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:37:32.275326 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-ae4b289f-1add-4f82-933e-e73c45400762 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Image limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:37:32.275783 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-ae4b289f-1add-4f82-933e-e73c45400762 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Flavor pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:37:32.276179 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-ae4b289f-1add-4f82-933e-e73c45400762 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Image pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:37:32.276577 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-ae4b289f-1add-4f82-933e-e73c45400762 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:37:32.285800 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ae4b289f-1add-4f82-933e-e73c45400762 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:32.286232 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ae4b289f-1add-4f82-933e-e73c45400762 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:32.287007 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ae4b289f-1add-4f82-933e-e73c45400762 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:32.287429 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ae4b289f-1add-4f82-933e-e73c45400762 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:32.304574 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-ae4b289f-1add-4f82-933e-e73c45400762 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Getting quotas for project abb12869989f45cc875ecb36dd1f7aef. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:37:32.308447 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-ae4b289f-1add-4f82-933e-e73c45400762 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Getting quotas for user 98f00ffeef484dd489ed67b96d1ed783 and project abb12869989f45cc875ecb36dd1f7aef. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:37:32.319066 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-ae4b289f-1add-4f82-933e-e73c45400762 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Going to run 1 instances... {{(pid=118461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:37:32.321327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-ae4b289f-1add-4f82-933e-e73c45400762 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ea875a4-facb-4053-be2d-ff0080d2f3a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:37:32.439624 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-ae4b289f-1add-4f82-933e-e73c45400762 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.742607 Jul 14 14:37:32.445753 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 359/705] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:37:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:37:32.451607 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c8d3e5a3-36fe-4fc5-a2ed-743b2b40268d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:32.452281 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c8d3e5a3-36fe-4fc5-a2ed-743b2b40268d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:32.513208 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-c8d3e5a3-36fe-4fc5-a2ed-743b2b40268d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:32.520631 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c8d3e5a3-36fe-4fc5-a2ed-743b2b40268d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580" status: 200 len: 1241 microversion: 2.1 time: 0.073112 Jul 14 14:37:32.521516 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 347/706] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:32 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:33.138137 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ca533ea8-7edf-41f8-851c-e44acb70b742 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:33.138727 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-ca533ea8-7edf-41f8-851c-e44acb70b742 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:33.140690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:33.146146 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ca533ea8-7edf-41f8-851c-e44acb70b742 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:33.146572 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ca533ea8-7edf-41f8-851c-e44acb70b742 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:33.147327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ca533ea8-7edf-41f8-851c-e44acb70b742 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:33.147759 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ca533ea8-7edf-41f8-851c-e44acb70b742 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:33.151667 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:33.282237 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-ca533ea8-7edf-41f8-851c-e44acb70b742 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:33.290175 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-ca533ea8-7edf-41f8-851c-e44acb70b742 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:33.291703 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-ca533ea8-7edf-41f8-851c-e44acb70b742 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:33.292853 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-ca533ea8-7edf-41f8-851c-e44acb70b742 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1725 microversion: 2.20 time: 0.159773 Jul 14 14:37:33.293420 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 360/707] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:33 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:33.537998 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-629bbd89-2aaf-4948-8a8e-1da138c1f686 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:33.538606 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-629bbd89-2aaf-4948-8a8e-1da138c1f686 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:33.591824 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-629bbd89-2aaf-4948-8a8e-1da138c1f686 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:33.598804 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-629bbd89-2aaf-4948-8a8e-1da138c1f686 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580" status: 200 len: 1241 microversion: 2.1 time: 0.064801 Jul 14 14:37:33.599352 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 348/708] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:33 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:34.310876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e3bc2501-03fa-42ae-9db6-6d4582e47451 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:34.311488 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e3bc2501-03fa-42ae-9db6-6d4582e47451 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:34.319458 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e3bc2501-03fa-42ae-9db6-6d4582e47451 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:34.319905 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e3bc2501-03fa-42ae-9db6-6d4582e47451 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:34.320657 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e3bc2501-03fa-42ae-9db6-6d4582e47451 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:34.321118 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e3bc2501-03fa-42ae-9db6-6d4582e47451 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:34.455587 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e3bc2501-03fa-42ae-9db6-6d4582e47451 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:34.463446 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e3bc2501-03fa-42ae-9db6-6d4582e47451 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:34.465472 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e3bc2501-03fa-42ae-9db6-6d4582e47451 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:34.466705 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e3bc2501-03fa-42ae-9db6-6d4582e47451 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1725 microversion: 2.20 time: 0.159755 Jul 14 14:37:34.467278 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 361/709] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:34 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:34.614943 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-26ffb517-5078-408b-90d5-d4248e624d0c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:34.615550 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-26ffb517-5078-408b-90d5-d4248e624d0c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:34.622058 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-26ffb517-5078-408b-90d5-d4248e624d0c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:34.622499 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-26ffb517-5078-408b-90d5-d4248e624d0c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:34.623256 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-26ffb517-5078-408b-90d5-d4248e624d0c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:34.623680 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-26ffb517-5078-408b-90d5-d4248e624d0c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:34.684753 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-26ffb517-5078-408b-90d5-d4248e624d0c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:34.692480 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-26ffb517-5078-408b-90d5-d4248e624d0c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580" status: 200 len: 1293 microversion: 2.1 time: 0.081366 Jul 14 14:37:34.693053 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 349/710] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:34 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:35.490804 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-3b1169bd-8439-4839-a901-5adf76605665 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:35.490804 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-3b1169bd-8439-4839-a901-5adf76605665 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:35.497754 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b1169bd-8439-4839-a901-5adf76605665 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:35.498258 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b1169bd-8439-4839-a901-5adf76605665 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:35.499150 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b1169bd-8439-4839-a901-5adf76605665 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:35.499577 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b1169bd-8439-4839-a901-5adf76605665 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:35.632690 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3b1169bd-8439-4839-a901-5adf76605665 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:35.640800 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3b1169bd-8439-4839-a901-5adf76605665 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:35.642502 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3b1169bd-8439-4839-a901-5adf76605665 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:35.643656 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-3b1169bd-8439-4839-a901-5adf76605665 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1725 microversion: 2.20 time: 0.160569 Jul 14 14:37:35.644212 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 362/711] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:35 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:35.709387 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-be8590b8-b226-4379-a2a1-0cbbd9416d43 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:35.710046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-be8590b8-b226-4379-a2a1-0cbbd9416d43 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:35.717229 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-be8590b8-b226-4379-a2a1-0cbbd9416d43 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:35.721977 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-be8590b8-b226-4379-a2a1-0cbbd9416d43 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:35.721977 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-be8590b8-b226-4379-a2a1-0cbbd9416d43 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:35.721977 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-be8590b8-b226-4379-a2a1-0cbbd9416d43 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:35.782461 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-be8590b8-b226-4379-a2a1-0cbbd9416d43 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:35.789914 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-be8590b8-b226-4379-a2a1-0cbbd9416d43 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580" status: 200 len: 1299 microversion: 2.1 time: 0.084501 Jul 14 14:37:35.791897 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 350/712] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:35 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:36.666951 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-525238cf-4bcb-44d6-ad5b-8a425df61fa9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:36.667577 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-525238cf-4bcb-44d6-ad5b-8a425df61fa9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:36.674597 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-525238cf-4bcb-44d6-ad5b-8a425df61fa9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:36.675030 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-525238cf-4bcb-44d6-ad5b-8a425df61fa9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:36.675779 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-525238cf-4bcb-44d6-ad5b-8a425df61fa9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:36.676201 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-525238cf-4bcb-44d6-ad5b-8a425df61fa9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:36.807609 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-9903a77f-1c68-432b-a935-2fd61fc74148 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:36.809112 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-9903a77f-1c68-432b-a935-2fd61fc74148 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:36.818327 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9903a77f-1c68-432b-a935-2fd61fc74148 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:36.819085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9903a77f-1c68-432b-a935-2fd61fc74148 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:36.819868 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9903a77f-1c68-432b-a935-2fd61fc74148 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:36.820305 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9903a77f-1c68-432b-a935-2fd61fc74148 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:36.828096 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-525238cf-4bcb-44d6-ad5b-8a425df61fa9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:36.842603 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-525238cf-4bcb-44d6-ad5b-8a425df61fa9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:36.844133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-525238cf-4bcb-44d6-ad5b-8a425df61fa9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:36.845519 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-525238cf-4bcb-44d6-ad5b-8a425df61fa9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1725 microversion: 2.20 time: 0.182638 Jul 14 14:37:36.856796 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 363/713] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:36 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:36.964599 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-9903a77f-1c68-432b-a935-2fd61fc74148 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:36.972608 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-9903a77f-1c68-432b-a935-2fd61fc74148 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580" status: 200 len: 1367 microversion: 2.1 time: 0.169393 Jul 14 14:37:36.973199 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 351/714] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:36 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:37.071109 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-cc605223-bc50-4250-b5d3-1b52fd2a823e req-095d1e78-0466-43a1-b472-0ccb35f9567a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36276a10-ba93-4cae-abe5-f5484419f580", "tag": "e62f2773-2ec1-41b9-b379-54b3094f80ef"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:37.084964 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-cc605223-bc50-4250-b5d3-1b52fd2a823e req-095d1e78-0466-43a1-b472-0ccb35f9567a service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.086523 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-cc605223-bc50-4250-b5d3-1b52fd2a823e req-095d1e78-0466-43a1-b472-0ccb35f9567a service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.101562 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-cc605223-bc50-4250-b5d3-1b52fd2a823e req-095d1e78-0466-43a1-b472-0ccb35f9567a service nova] Creating event network-changed:e62f2773-2ec1-41b9-b379-54b3094f80ef for instance 36276a10-ba93-4cae-abe5-f5484419f580 on hv-cinder-79987 Jul 14 14:37:37.109715 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-cc605223-bc50-4250-b5d3-1b52fd2a823e req-095d1e78-0466-43a1-b472-0ccb35f9567a service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043643 Jul 14 14:37:37.109715 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 364/715] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:37.864172 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-72080928-4522-42ee-969d-caeeb34c860a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:37.864749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-72080928-4522-42ee-969d-caeeb34c860a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:37.871873 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-72080928-4522-42ee-969d-caeeb34c860a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.872343 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-72080928-4522-42ee-969d-caeeb34c860a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.873089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-72080928-4522-42ee-969d-caeeb34c860a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.873510 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-72080928-4522-42ee-969d-caeeb34c860a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.990953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-3d985c18-ffb6-46aa-a225-6c8740848e6d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:37.991731 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-3d985c18-ffb6-46aa-a225-6c8740848e6d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:37.999559 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3d985c18-ffb6-46aa-a225-6c8740848e6d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.999961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3d985c18-ffb6-46aa-a225-6c8740848e6d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:38.000733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3d985c18-ffb6-46aa-a225-6c8740848e6d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:38.001171 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3d985c18-ffb6-46aa-a225-6c8740848e6d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:38.020325 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-72080928-4522-42ee-969d-caeeb34c860a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:38.024447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-72080928-4522-42ee-969d-caeeb34c860a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:38.026004 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-72080928-4522-42ee-969d-caeeb34c860a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:38.027167 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-72080928-4522-42ee-969d-caeeb34c860a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1725 microversion: 2.20 time: 0.167027 Jul 14 14:37:38.028166 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 352/716] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:37 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:38.134596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3d985c18-ffb6-46aa-a225-6c8740848e6d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:38.142358 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-3d985c18-ffb6-46aa-a225-6c8740848e6d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580" status: 200 len: 1367 microversion: 2.1 time: 0.155677 Jul 14 14:37:38.142921 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 365/717] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:37 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:37:39.046120 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-1655a0be-080e-4398-a901-f5680c9c31de tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:39.049877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-1655a0be-080e-4398-a901-f5680c9c31de tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:39.053265 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1655a0be-080e-4398-a901-f5680c9c31de tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:39.053706 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1655a0be-080e-4398-a901-f5680c9c31de tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:39.054481 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1655a0be-080e-4398-a901-f5680c9c31de tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:39.054904 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1655a0be-080e-4398-a901-f5680c9c31de tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:39.159227 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a9531037-b11d-4767-ab32-309834745579 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:39.159921 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a9531037-b11d-4767-ab32-309834745579 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:39.168208 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a9531037-b11d-4767-ab32-309834745579 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:39.168208 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a9531037-b11d-4767-ab32-309834745579 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:39.168555 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a9531037-b11d-4767-ab32-309834745579 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:39.169050 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a9531037-b11d-4767-ab32-309834745579 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:39.191395 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-1655a0be-080e-4398-a901-f5680c9c31de tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:39.199962 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-1655a0be-080e-4398-a901-f5680c9c31de tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:39.201483 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-1655a0be-080e-4398-a901-f5680c9c31de tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:39.202917 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-1655a0be-080e-4398-a901-f5680c9c31de tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1725 microversion: 2.20 time: 0.161296 Jul 14 14:37:39.203652 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 353/718] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:39 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:39.306815 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a9531037-b11d-4767-ab32-309834745579 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:39.315086 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a9531037-b11d-4767-ab32-309834745579 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580" status: 200 len: 1367 microversion: 2.1 time: 0.159779 Jul 14 14:37:39.315661 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 366/719] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:39 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:40.221136 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-87ffe1f6-f086-4633-ba9f-7987cc1fb5b5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:40.221717 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-87ffe1f6-f086-4633-ba9f-7987cc1fb5b5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:40.228149 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-87ffe1f6-f086-4633-ba9f-7987cc1fb5b5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:40.228593 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-87ffe1f6-f086-4633-ba9f-7987cc1fb5b5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:40.229351 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-87ffe1f6-f086-4633-ba9f-7987cc1fb5b5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:40.230069 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-87ffe1f6-f086-4633-ba9f-7987cc1fb5b5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:40.331830 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-28311d69-6136-4bca-8d26-e62186ddebdb tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:40.332442 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-28311d69-6136-4bca-8d26-e62186ddebdb tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:40.339039 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-28311d69-6136-4bca-8d26-e62186ddebdb tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:40.339492 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-28311d69-6136-4bca-8d26-e62186ddebdb tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:40.340260 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-28311d69-6136-4bca-8d26-e62186ddebdb tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:40.340693 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-28311d69-6136-4bca-8d26-e62186ddebdb tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:40.356754 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-87ffe1f6-f086-4633-ba9f-7987cc1fb5b5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:40.364720 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-87ffe1f6-f086-4633-ba9f-7987cc1fb5b5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:40.366353 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-87ffe1f6-f086-4633-ba9f-7987cc1fb5b5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:40.367555 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-87ffe1f6-f086-4633-ba9f-7987cc1fb5b5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1746 microversion: 2.20 time: 0.150331 Jul 14 14:37:40.368114 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 354/720] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:40 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:40.469961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-28311d69-6136-4bca-8d26-e62186ddebdb tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:40.477247 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-28311d69-6136-4bca-8d26-e62186ddebdb tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580" status: 200 len: 1367 microversion: 2.1 time: 0.149400 Jul 14 14:37:40.477819 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 367/721] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:40 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:37:41.386751 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-3750e722-5ddf-4af2-902c-981c905ce602 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:41.387274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-3750e722-5ddf-4af2-902c-981c905ce602 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:41.393655 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3750e722-5ddf-4af2-902c-981c905ce602 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:41.394122 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3750e722-5ddf-4af2-902c-981c905ce602 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:41.394870 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3750e722-5ddf-4af2-902c-981c905ce602 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:41.395294 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3750e722-5ddf-4af2-902c-981c905ce602 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:41.495484 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-122a3d39-b050-42dd-9b88-e95fd03b037a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:41.497253 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-122a3d39-b050-42dd-9b88-e95fd03b037a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:41.506402 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-122a3d39-b050-42dd-9b88-e95fd03b037a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:41.508436 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-122a3d39-b050-42dd-9b88-e95fd03b037a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:41.509808 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-122a3d39-b050-42dd-9b88-e95fd03b037a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:41.510691 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-122a3d39-b050-42dd-9b88-e95fd03b037a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:41.543032 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-3750e722-5ddf-4af2-902c-981c905ce602 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:41.545518 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-3750e722-5ddf-4af2-902c-981c905ce602 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:41.547198 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-3750e722-5ddf-4af2-902c-981c905ce602 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:41.548434 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-3750e722-5ddf-4af2-902c-981c905ce602 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1746 microversion: 2.20 time: 0.165846 Jul 14 14:37:41.548986 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 355/722] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:41 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:41.553943 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-d0802112-f446-49a9-b041-8c747f8e01ff req-1125880f-da7b-47d9-b411-8124ba31b428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36276a10-ba93-4cae-abe5-f5484419f580", "name": "network-vif-plugged", "status": "completed", "tag": "e62f2773-2ec1-41b9-b379-54b3094f80ef"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:41.563175 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-d0802112-f446-49a9-b041-8c747f8e01ff req-1125880f-da7b-47d9-b411-8124ba31b428 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:41.563601 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-d0802112-f446-49a9-b041-8c747f8e01ff req-1125880f-da7b-47d9-b411-8124ba31b428 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:41.575355 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-d0802112-f446-49a9-b041-8c747f8e01ff req-1125880f-da7b-47d9-b411-8124ba31b428 service nova] Creating event network-vif-plugged:e62f2773-2ec1-41b9-b379-54b3094f80ef for instance 36276a10-ba93-4cae-abe5-f5484419f580 on hv-cinder-79987 Jul 14 14:37:41.580306 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-d0802112-f446-49a9-b041-8c747f8e01ff req-1125880f-da7b-47d9-b411-8124ba31b428 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029833 Jul 14 14:37:41.580896 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 356/723] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:41.663190 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-122a3d39-b050-42dd-9b88-e95fd03b037a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:41.671457 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-122a3d39-b050-42dd-9b88-e95fd03b037a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580" status: 200 len: 1367 microversion: 2.1 time: 0.181111 Jul 14 14:37:41.672037 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 368/724] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:41 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:37:42.572920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7549fa5a-6544-467b-b941-4efbcfc12236 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:42.574487 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-7549fa5a-6544-467b-b941-4efbcfc12236 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:42.582458 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7549fa5a-6544-467b-b941-4efbcfc12236 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:42.582855 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7549fa5a-6544-467b-b941-4efbcfc12236 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:42.583632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7549fa5a-6544-467b-b941-4efbcfc12236 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:42.584066 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7549fa5a-6544-467b-b941-4efbcfc12236 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:42.689443 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-fc6c0f5f-f96c-403f-b71c-b42b194cebc2 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:42.695013 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-fc6c0f5f-f96c-403f-b71c-b42b194cebc2 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:42.696723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:42.698269 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=6 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:42.700819 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fc6c0f5f-f96c-403f-b71c-b42b194cebc2 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:42.701542 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fc6c0f5f-f96c-403f-b71c-b42b194cebc2 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:42.702568 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fc6c0f5f-f96c-403f-b71c-b42b194cebc2 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:42.703161 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fc6c0f5f-f96c-403f-b71c-b42b194cebc2 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:42.766322 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7549fa5a-6544-467b-b941-4efbcfc12236 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:42.775919 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7549fa5a-6544-467b-b941-4efbcfc12236 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:42.778851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7549fa5a-6544-467b-b941-4efbcfc12236 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:42.780156 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-7549fa5a-6544-467b-b941-4efbcfc12236 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1741 microversion: 2.20 time: 0.215246 Jul 14 14:37:42.781392 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 357/725] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:42 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1741 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:42.860882 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-fc6c0f5f-f96c-403f-b71c-b42b194cebc2 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:42.872504 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-fc6c0f5f-f96c-403f-b71c-b42b194cebc2 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580" status: 200 len: 1367 microversion: 2.1 time: 0.187182 Jul 14 14:37:42.873388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 369/726] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:42 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:37:43.604083 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-f42247c0-4001-4e3e-a5d0-8d17ccf57efa req-c59f7614-5a3f-47cc-9c7b-065db11d3731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d810a21-86d3-4d18-b9d6-eae39990ac26", "name": "network-vif-plugged", "status": "completed", "tag": "56e9cb11-f5b0-4131-82d8-c97417b17d2c"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:43.610287 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=8 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:43.619694 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-f42247c0-4001-4e3e-a5d0-8d17ccf57efa req-c59f7614-5a3f-47cc-9c7b-065db11d3731 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:43.620509 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-f42247c0-4001-4e3e-a5d0-8d17ccf57efa req-c59f7614-5a3f-47cc-9c7b-065db11d3731 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:43.642299 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-f42247c0-4001-4e3e-a5d0-8d17ccf57efa req-c59f7614-5a3f-47cc-9c7b-065db11d3731 service nova] Creating event network-vif-plugged:56e9cb11-f5b0-4131-82d8-c97417b17d2c for instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 on hv-cinder-79987 Jul 14 14:37:43.648460 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-f42247c0-4001-4e3e-a5d0-8d17ccf57efa req-c59f7614-5a3f-47cc-9c7b-065db11d3731 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055305 Jul 14 14:37:43.649910 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 358/727] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:37:43.799501 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0913ac0c-e099-4333-81d4-fdd87ffec17f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:43.800170 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-0913ac0c-e099-4333-81d4-fdd87ffec17f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:43.807441 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0913ac0c-e099-4333-81d4-fdd87ffec17f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:43.807888 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0913ac0c-e099-4333-81d4-fdd87ffec17f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:43.808685 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0913ac0c-e099-4333-81d4-fdd87ffec17f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:43.809132 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0913ac0c-e099-4333-81d4-fdd87ffec17f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:43.892057 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-4c81cb5b-a1ed-49d4-88ec-3c874df48aa1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:43.893060 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-4c81cb5b-a1ed-49d4-88ec-3c874df48aa1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:43.912550 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4c81cb5b-a1ed-49d4-88ec-3c874df48aa1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:43.913288 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4c81cb5b-a1ed-49d4-88ec-3c874df48aa1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:43.915655 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4c81cb5b-a1ed-49d4-88ec-3c874df48aa1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:43.917269 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4c81cb5b-a1ed-49d4-88ec-3c874df48aa1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:43.996472 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-0913ac0c-e099-4333-81d4-fdd87ffec17f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:44.011637 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-0913ac0c-e099-4333-81d4-fdd87ffec17f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:44.015017 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-0913ac0c-e099-4333-81d4-fdd87ffec17f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:44.017323 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-0913ac0c-e099-4333-81d4-fdd87ffec17f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1741 microversion: 2.20 time: 0.219673 Jul 14 14:37:44.017963 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 370/728] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:43 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1741 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:44.149186 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-4c81cb5b-a1ed-49d4-88ec-3c874df48aa1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:44.158298 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-4c81cb5b-a1ed-49d4-88ec-3c874df48aa1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580" status: 200 len: 1557 microversion: 2.1 time: 0.272874 Jul 14 14:37:44.170762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 359/729] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:43 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 => generated 1557 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:37:44.177892 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a19a7fad-a649-4a68-86a5-bf8df6316a6b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:44.179368 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a19a7fad-a649-4a68-86a5-bf8df6316a6b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:44.186588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a19a7fad-a649-4a68-86a5-bf8df6316a6b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:44.187027 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a19a7fad-a649-4a68-86a5-bf8df6316a6b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:44.187994 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a19a7fad-a649-4a68-86a5-bf8df6316a6b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:44.188765 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a19a7fad-a649-4a68-86a5-bf8df6316a6b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:44.446961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a19a7fad-a649-4a68-86a5-bf8df6316a6b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.273778 Jul 14 14:37:44.447809 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 371/730] 10.222.0.93 () {58 vars in 1274 bytes} [Thu Jul 14 14:37:44 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580/os-interface => generated 285 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:45.037973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-bb082c0c-6571-4da3-a5bc-4edd1fedf693 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:45.038581 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-bb082c0c-6571-4da3-a5bc-4edd1fedf693 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:45.048831 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bb082c0c-6571-4da3-a5bc-4edd1fedf693 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:45.052075 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bb082c0c-6571-4da3-a5bc-4edd1fedf693 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:45.053179 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bb082c0c-6571-4da3-a5bc-4edd1fedf693 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:45.053626 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bb082c0c-6571-4da3-a5bc-4edd1fedf693 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:45.585149 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-bb082c0c-6571-4da3-a5bc-4edd1fedf693 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:45.594126 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-bb082c0c-6571-4da3-a5bc-4edd1fedf693 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:45.595710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-bb082c0c-6571-4da3-a5bc-4edd1fedf693 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:45.597906 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-bb082c0c-6571-4da3-a5bc-4edd1fedf693 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1741 microversion: 2.20 time: 0.564145 Jul 14 14:37:45.598694 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 360/731] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:45 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1741 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:45.899790 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-ba005d4b-21a6-43e5-9ba8-f43b22f8286b req-6817ca27-f4cd-47da-bdbc-91d8d37bfcc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36276a10-ba93-4cae-abe5-f5484419f580", "tag": "e62f2773-2ec1-41b9-b379-54b3094f80ef"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:45.908567 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-ba005d4b-21a6-43e5-9ba8-f43b22f8286b req-6817ca27-f4cd-47da-bdbc-91d8d37bfcc1 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:45.909025 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-ba005d4b-21a6-43e5-9ba8-f43b22f8286b req-6817ca27-f4cd-47da-bdbc-91d8d37bfcc1 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:45.920944 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-ba005d4b-21a6-43e5-9ba8-f43b22f8286b req-6817ca27-f4cd-47da-bdbc-91d8d37bfcc1 service nova] Creating event network-changed:e62f2773-2ec1-41b9-b379-54b3094f80ef for instance 36276a10-ba93-4cae-abe5-f5484419f580 on hv-cinder-79987 Jul 14 14:37:45.925967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-ba005d4b-21a6-43e5-9ba8-f43b22f8286b req-6817ca27-f4cd-47da-bdbc-91d8d37bfcc1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029848 Jul 14 14:37:45.926750 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 372/732] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:46.616532 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-8a945767-3d94-45ec-b108-9c413e4274b9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:46.617106 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-8a945767-3d94-45ec-b108-9c413e4274b9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:46.626038 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8a945767-3d94-45ec-b108-9c413e4274b9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:46.626629 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8a945767-3d94-45ec-b108-9c413e4274b9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:46.627510 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8a945767-3d94-45ec-b108-9c413e4274b9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:46.628041 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8a945767-3d94-45ec-b108-9c413e4274b9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:46.657595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=100 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:46.813203 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-8a945767-3d94-45ec-b108-9c413e4274b9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:46.822968 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-8a945767-3d94-45ec-b108-9c413e4274b9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:46.825136 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-8a945767-3d94-45ec-b108-9c413e4274b9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:46.826420 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-8a945767-3d94-45ec-b108-9c413e4274b9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1741 microversion: 2.20 time: 0.214017 Jul 14 14:37:46.827054 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 361/733] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:46 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1741 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:47.845832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a58b27dc-21d2-4f7f-931d-0d05808a5398 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:47.847962 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a58b27dc-21d2-4f7f-931d-0d05808a5398 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:47.854934 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a58b27dc-21d2-4f7f-931d-0d05808a5398 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.855614 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a58b27dc-21d2-4f7f-931d-0d05808a5398 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.858659 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a58b27dc-21d2-4f7f-931d-0d05808a5398 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.859094 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a58b27dc-21d2-4f7f-931d-0d05808a5398 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:48.003132 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a58b27dc-21d2-4f7f-931d-0d05808a5398 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:48.012066 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a58b27dc-21d2-4f7f-931d-0d05808a5398 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:48.013604 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a58b27dc-21d2-4f7f-931d-0d05808a5398 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:48.014843 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a58b27dc-21d2-4f7f-931d-0d05808a5398 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1741 microversion: 2.20 time: 0.173927 Jul 14 14:37:48.015833 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 373/734] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:47 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:49.034284 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-6199f44f-ea9d-4884-b53a-62c891094e34 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:49.034914 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-6199f44f-ea9d-4884-b53a-62c891094e34 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:49.041810 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6199f44f-ea9d-4884-b53a-62c891094e34 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:49.042254 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6199f44f-ea9d-4884-b53a-62c891094e34 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:49.043526 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6199f44f-ea9d-4884-b53a-62c891094e34 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:49.043955 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6199f44f-ea9d-4884-b53a-62c891094e34 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:49.176636 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-6199f44f-ea9d-4884-b53a-62c891094e34 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:49.185126 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-6199f44f-ea9d-4884-b53a-62c891094e34 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:49.186649 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-6199f44f-ea9d-4884-b53a-62c891094e34 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:49.187780 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-6199f44f-ea9d-4884-b53a-62c891094e34 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1741 microversion: 2.20 time: 0.157437 Jul 14 14:37:49.188330 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 362/735] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:49 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:50.210644 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-82029072-fffc-4645-8417-c7159ea7ee0d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:50.215438 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-82029072-fffc-4645-8417-c7159ea7ee0d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:50.218790 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-82029072-fffc-4645-8417-c7159ea7ee0d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:50.219233 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-82029072-fffc-4645-8417-c7159ea7ee0d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:50.219996 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-82029072-fffc-4645-8417-c7159ea7ee0d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:50.220420 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-82029072-fffc-4645-8417-c7159ea7ee0d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:50.378843 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-82029072-fffc-4645-8417-c7159ea7ee0d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:50.387313 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-82029072-fffc-4645-8417-c7159ea7ee0d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:50.388825 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-82029072-fffc-4645-8417-c7159ea7ee0d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:50.390000 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-82029072-fffc-4645-8417-c7159ea7ee0d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1741 microversion: 2.20 time: 0.183243 Jul 14 14:37:50.397637 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 374/736] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:50 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:51.411290 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-38cad8e5-b9eb-45a5-aaa2-a71db2a80d1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:51.411887 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-38cad8e5-b9eb-45a5-aaa2-a71db2a80d1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:51.421230 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-38cad8e5-b9eb-45a5-aaa2-a71db2a80d1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:51.421930 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-38cad8e5-b9eb-45a5-aaa2-a71db2a80d1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:51.422836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-38cad8e5-b9eb-45a5-aaa2-a71db2a80d1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:51.423274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-38cad8e5-b9eb-45a5-aaa2-a71db2a80d1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:51.564929 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-38cad8e5-b9eb-45a5-aaa2-a71db2a80d1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:51.573829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-38cad8e5-b9eb-45a5-aaa2-a71db2a80d1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:51.575337 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-38cad8e5-b9eb-45a5-aaa2-a71db2a80d1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:51.576492 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-38cad8e5-b9eb-45a5-aaa2-a71db2a80d1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1741 microversion: 2.20 time: 0.169275 Jul 14 14:37:51.582043 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 363/737] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:51 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:52.600639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-74d4a9d6-2b45-4ce1-9d07-c1e7f17bb0eb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:52.601404 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-74d4a9d6-2b45-4ce1-9d07-c1e7f17bb0eb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:52.612351 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-74d4a9d6-2b45-4ce1-9d07-c1e7f17bb0eb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:52.612800 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-74d4a9d6-2b45-4ce1-9d07-c1e7f17bb0eb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:52.613569 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-74d4a9d6-2b45-4ce1-9d07-c1e7f17bb0eb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:52.614018 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-74d4a9d6-2b45-4ce1-9d07-c1e7f17bb0eb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:52.753408 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-74d4a9d6-2b45-4ce1-9d07-c1e7f17bb0eb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:52.762215 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-74d4a9d6-2b45-4ce1-9d07-c1e7f17bb0eb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:52.763790 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-74d4a9d6-2b45-4ce1-9d07-c1e7f17bb0eb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:52.764947 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-74d4a9d6-2b45-4ce1-9d07-c1e7f17bb0eb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1741 microversion: 2.20 time: 0.168489 Jul 14 14:37:52.765510 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 375/738] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:52 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:53.784982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a0924d91-0d31-469d-ac09-e0cc6cb62706 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:53.786001 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a0924d91-0d31-469d-ac09-e0cc6cb62706 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:53.795620 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a0924d91-0d31-469d-ac09-e0cc6cb62706 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:53.795620 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a0924d91-0d31-469d-ac09-e0cc6cb62706 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:53.795620 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a0924d91-0d31-469d-ac09-e0cc6cb62706 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:53.796460 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a0924d91-0d31-469d-ac09-e0cc6cb62706 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:53.801365 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c5ecba2a-2688-4ee8-ae45-28aedaf07205 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:53.801929 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c5ecba2a-2688-4ee8-ae45-28aedaf07205 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:53.807955 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c5ecba2a-2688-4ee8-ae45-28aedaf07205 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:53.808571 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c5ecba2a-2688-4ee8-ae45-28aedaf07205 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:53.809317 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c5ecba2a-2688-4ee8-ae45-28aedaf07205 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:53.809746 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c5ecba2a-2688-4ee8-ae45-28aedaf07205 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:53.845272 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c5ecba2a-2688-4ee8-ae45-28aedaf07205 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Going to try to terminate instance {{(pid=118461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:37:53.931958 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a0924d91-0d31-469d-ac09-e0cc6cb62706 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:53.940052 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a0924d91-0d31-469d-ac09-e0cc6cb62706 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:53.941690 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a0924d91-0d31-469d-ac09-e0cc6cb62706 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:53.943091 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a0924d91-0d31-469d-ac09-e0cc6cb62706 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1741 microversion: 2.20 time: 0.163009 Jul 14 14:37:53.943652 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 364/739] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:53 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:53.948007 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-d882b638-aeb7-49d3-892c-787ffaf46ca1 req-f9188504-d064-4b6d-ad72-18d2887534e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "833f486d-a5d2-41ff-8404-19f21892e73c", "tag": "7f554063-5f76-4260-95f2-f9417cf2981a"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:53.956052 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-d882b638-aeb7-49d3-892c-787ffaf46ca1 req-f9188504-d064-4b6d-ad72-18d2887534e6 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:53.956498 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-d882b638-aeb7-49d3-892c-787ffaf46ca1 req-f9188504-d064-4b6d-ad72-18d2887534e6 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:53.968386 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-d882b638-aeb7-49d3-892c-787ffaf46ca1 req-f9188504-d064-4b6d-ad72-18d2887534e6 service nova] Creating event network-changed:7f554063-5f76-4260-95f2-f9417cf2981a for instance 833f486d-a5d2-41ff-8404-19f21892e73c on hv-cinder-79987 Jul 14 14:37:53.973492 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-d882b638-aeb7-49d3-892c-787ffaf46ca1 req-f9188504-d064-4b6d-ad72-18d2887534e6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028694 Jul 14 14:37:53.974220 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 365/740] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:54.004942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:54.254436 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c5ecba2a-2688-4ee8-ae45-28aedaf07205 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "DELETE /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 204 len: 0 microversion: 2.1 time: 0.456702 Jul 14 14:37:54.255399 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 376/741] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:37:53 2022] DELETE /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:37:54.265097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c66ad561-83f4-4954-946c-3b74e79df4aa tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:54.265819 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c66ad561-83f4-4954-946c-3b74e79df4aa tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:54.274926 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c66ad561-83f4-4954-946c-3b74e79df4aa tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:54.275386 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c66ad561-83f4-4954-946c-3b74e79df4aa tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:54.276156 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c66ad561-83f4-4954-946c-3b74e79df4aa tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:54.276582 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c66ad561-83f4-4954-946c-3b74e79df4aa tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:54.413456 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-c66ad561-83f4-4954-946c-3b74e79df4aa tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:54.421338 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c66ad561-83f4-4954-946c-3b74e79df4aa tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.161355 Jul 14 14:37:54.431341 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 366/742] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:54 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:54.962481 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c801bb91-51cf-49c6-842c-3ced7a4d01b1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:54.963190 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c801bb91-51cf-49c6-842c-3ced7a4d01b1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:54.969939 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c801bb91-51cf-49c6-842c-3ced7a4d01b1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:54.970405 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c801bb91-51cf-49c6-842c-3ced7a4d01b1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:54.971149 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c801bb91-51cf-49c6-842c-3ced7a4d01b1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:54.971570 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c801bb91-51cf-49c6-842c-3ced7a4d01b1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:55.102579 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c801bb91-51cf-49c6-842c-3ced7a4d01b1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:55.111232 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c801bb91-51cf-49c6-842c-3ced7a4d01b1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:55.112756 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c801bb91-51cf-49c6-842c-3ced7a4d01b1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:55.113937 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c801bb91-51cf-49c6-842c-3ced7a4d01b1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1723 microversion: 2.20 time: 0.156245 Jul 14 14:37:55.114487 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 377/743] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:54 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:55.438591 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-13eeb6c5-02c9-4339-a9f4-1b5be52ee521 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:55.439250 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-13eeb6c5-02c9-4339-a9f4-1b5be52ee521 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:55.445851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-13eeb6c5-02c9-4339-a9f4-1b5be52ee521 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:55.446300 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-13eeb6c5-02c9-4339-a9f4-1b5be52ee521 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:55.447062 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-13eeb6c5-02c9-4339-a9f4-1b5be52ee521 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:55.447522 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-13eeb6c5-02c9-4339-a9f4-1b5be52ee521 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:55.588986 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-13eeb6c5-02c9-4339-a9f4-1b5be52ee521 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:55.597193 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-13eeb6c5-02c9-4339-a9f4-1b5be52ee521 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1566 microversion: 2.1 time: 0.162465 Jul 14 14:37:55.598005 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 367/744] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:55 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:56.132695 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c5ec3eae-c74a-4e09-beca-f95a72b55019 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:56.133285 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c5ec3eae-c74a-4e09-beca-f95a72b55019 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:56.140602 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c5ec3eae-c74a-4e09-beca-f95a72b55019 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:56.141040 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c5ec3eae-c74a-4e09-beca-f95a72b55019 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.141810 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c5ec3eae-c74a-4e09-beca-f95a72b55019 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:56.142233 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c5ec3eae-c74a-4e09-beca-f95a72b55019 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.271412 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c5ec3eae-c74a-4e09-beca-f95a72b55019 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:56.280018 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c5ec3eae-c74a-4e09-beca-f95a72b55019 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:56.281925 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c5ec3eae-c74a-4e09-beca-f95a72b55019 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:56.283098 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c5ec3eae-c74a-4e09-beca-f95a72b55019 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1723 microversion: 2.20 time: 0.154358 Jul 14 14:37:56.283657 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 378/745] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:56 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:56.550632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-fe45d016-0b56-4ed0-a98d-672fab9aefc0 req-e026f2c4-cbff-416d-8bfc-f3e2b0c2d18f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833f486d-a5d2-41ff-8404-19f21892e73c", "name": "network-vif-deleted", "tag": "7f554063-5f76-4260-95f2-f9417cf2981a"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:56.559685 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-fe45d016-0b56-4ed0-a98d-672fab9aefc0 req-e026f2c4-cbff-416d-8bfc-f3e2b0c2d18f service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:56.560126 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-fe45d016-0b56-4ed0-a98d-672fab9aefc0 req-e026f2c4-cbff-416d-8bfc-f3e2b0c2d18f service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.571821 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-fe45d016-0b56-4ed0-a98d-672fab9aefc0 req-e026f2c4-cbff-416d-8bfc-f3e2b0c2d18f service nova] Creating event network-vif-deleted:7f554063-5f76-4260-95f2-f9417cf2981a for instance 833f486d-a5d2-41ff-8404-19f21892e73c on hv-cinder-79987 Jul 14 14:37:56.576611 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-fe45d016-0b56-4ed0-a98d-672fab9aefc0 req-e026f2c4-cbff-416d-8bfc-f3e2b0c2d18f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029796 Jul 14 14:37:56.577190 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 368/746] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:56.615000 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-cb6efee3-8280-468b-9e75-fee020234905 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:56.615606 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-cb6efee3-8280-468b-9e75-fee020234905 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:56.622971 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cb6efee3-8280-468b-9e75-fee020234905 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:56.623411 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cb6efee3-8280-468b-9e75-fee020234905 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.624170 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cb6efee3-8280-468b-9e75-fee020234905 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:56.624606 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cb6efee3-8280-468b-9e75-fee020234905 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.685337 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-cb6efee3-8280-468b-9e75-fee020234905 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:56.692816 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-cb6efee3-8280-468b-9e75-fee020234905 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1499 microversion: 2.1 time: 0.081722 Jul 14 14:37:56.693380 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 379/747] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:56 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1499 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:57.302315 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e704c460-7eeb-4aca-9620-c57ed8ab1664 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:57.302990 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e704c460-7eeb-4aca-9620-c57ed8ab1664 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:57.304908 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:57.309758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e704c460-7eeb-4aca-9620-c57ed8ab1664 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:57.310226 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e704c460-7eeb-4aca-9620-c57ed8ab1664 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:57.310980 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e704c460-7eeb-4aca-9620-c57ed8ab1664 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:57.311411 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e704c460-7eeb-4aca-9620-c57ed8ab1664 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:57.373731 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-f6666b3d-ff94-4c4d-abe8-382cb5015b44 req-6efdbb0b-2956-471c-b2d4-1a8063e0d0da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d810a21-86d3-4d18-b9d6-eae39990ac26", "name": "network-vif-unplugged", "status": "completed", "tag": "56e9cb11-f5b0-4131-82d8-c97417b17d2c"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:57.383620 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-f6666b3d-ff94-4c4d-abe8-382cb5015b44 req-6efdbb0b-2956-471c-b2d4-1a8063e0d0da service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:57.384058 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-f6666b3d-ff94-4c4d-abe8-382cb5015b44 req-6efdbb0b-2956-471c-b2d4-1a8063e0d0da service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:57.395876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-f6666b3d-ff94-4c4d-abe8-382cb5015b44 req-6efdbb0b-2956-471c-b2d4-1a8063e0d0da service nova] Creating event network-vif-unplugged:56e9cb11-f5b0-4131-82d8-c97417b17d2c for instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 on hv-cinder-79987 Jul 14 14:37:57.400853 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-f6666b3d-ff94-4c4d-abe8-382cb5015b44 req-6efdbb0b-2956-471c-b2d4-1a8063e0d0da service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032378 Jul 14 14:37:57.401425 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 380/748] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:37:57.447635 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e704c460-7eeb-4aca-9620-c57ed8ab1664 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:57.456210 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e704c460-7eeb-4aca-9620-c57ed8ab1664 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:57.457944 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e704c460-7eeb-4aca-9620-c57ed8ab1664 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:57.459050 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e704c460-7eeb-4aca-9620-c57ed8ab1664 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1723 microversion: 2.20 time: 0.161127 Jul 14 14:37:57.459600 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 369/749] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:57 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:57.710388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ad09ba65-efdd-410c-9d13-d5a6e75dd816 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:57.710989 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-ad09ba65-efdd-410c-9d13-d5a6e75dd816 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:57.717557 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ad09ba65-efdd-410c-9d13-d5a6e75dd816 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:57.718023 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ad09ba65-efdd-410c-9d13-d5a6e75dd816 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:57.718772 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ad09ba65-efdd-410c-9d13-d5a6e75dd816 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:57.719203 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ad09ba65-efdd-410c-9d13-d5a6e75dd816 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:57.788133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-ad09ba65-efdd-410c-9d13-d5a6e75dd816 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:57.796855 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-ad09ba65-efdd-410c-9d13-d5a6e75dd816 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1218 microversion: 2.1 time: 0.090760 Jul 14 14:37:57.797516 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 381/750] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:57 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:58.476665 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-81528e7f-c164-4cf9-a397-d761edec8826 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:58.477204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-81528e7f-c164-4cf9-a397-d761edec8826 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:58.483856 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-81528e7f-c164-4cf9-a397-d761edec8826 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:58.484312 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-81528e7f-c164-4cf9-a397-d761edec8826 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:58.485043 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-81528e7f-c164-4cf9-a397-d761edec8826 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:58.485468 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-81528e7f-c164-4cf9-a397-d761edec8826 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:58.618961 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-81528e7f-c164-4cf9-a397-d761edec8826 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:58.628056 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-81528e7f-c164-4cf9-a397-d761edec8826 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:58.629552 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-81528e7f-c164-4cf9-a397-d761edec8826 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:58.630726 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-81528e7f-c164-4cf9-a397-d761edec8826 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1726 microversion: 2.20 time: 0.158058 Jul 14 14:37:58.631295 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 370/751] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:58 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:37:58.648063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-cc38d708-073e-46e6-91bf-3b21a61a85d9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae96d159-824d-4f4f-832c-1390e5af3707"}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:58.649102 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-cc38d708-073e-46e6-91bf-3b21a61a85d9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:58.655503 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cc38d708-073e-46e6-91bf-3b21a61a85d9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:58.655936 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cc38d708-073e-46e6-91bf-3b21a61a85d9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:58.656671 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cc38d708-073e-46e6-91bf-3b21a61a85d9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:58.657096 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cc38d708-073e-46e6-91bf-3b21a61a85d9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:58.814736 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-dfabbfe6-0601-4118-96cd-0851bd923359 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:58.815350 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-dfabbfe6-0601-4118-96cd-0851bd923359 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:58.821451 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-dfabbfe6-0601-4118-96cd-0851bd923359 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:58.821950 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-dfabbfe6-0601-4118-96cd-0851bd923359 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:58.822697 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-dfabbfe6-0601-4118-96cd-0851bd923359 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:58.823130 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-dfabbfe6-0601-4118-96cd-0851bd923359 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:58.853268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-dfabbfe6-0601-4118-96cd-0851bd923359 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:58.853719 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-dfabbfe6-0601-4118-96cd-0851bd923359 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:58.854191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-dfabbfe6-0601-4118-96cd-0851bd923359 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lazy-loading 'fault' on Instance uuid 833f486d-a5d2-41ff-8404-19f21892e73c {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:37:58.918869 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-dfabbfe6-0601-4118-96cd-0851bd923359 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f86340c271b64c14b30834c51a477ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36d14d5bd24ed39bcb0a32dfa016f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:58.926408 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-dfabbfe6-0601-4118-96cd-0851bd923359 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 200 len: 1223 microversion: 2.1 time: 0.115549 Jul 14 14:37:58.926971 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 371/752] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:58 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 1223 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:59.944590 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-82362196-44a1-4718-8aee-7e558c77cef9 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:59.945249 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-82362196-44a1-4718-8aee-7e558c77cef9 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] [instance: 833f486d-a5d2-41ff-8404-19f21892e73c] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:59.952548 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-82362196-44a1-4718-8aee-7e558c77cef9 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:59.953023 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-82362196-44a1-4718-8aee-7e558c77cef9 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:59.953786 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-82362196-44a1-4718-8aee-7e558c77cef9 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:59.954215 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-82362196-44a1-4718-8aee-7e558c77cef9 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:59.968000 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-82362196-44a1-4718-8aee-7e558c77cef9 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] HTTP exception thrown: Instance 833f486d-a5d2-41ff-8404-19f21892e73c could not be found. Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-82362196-44a1-4718-8aee-7e558c77cef9 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Request method failure captured: Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c HTTP/1.1 Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0CjsZbq0gCTb8v_5-6YUST-IjeLbJeCPd2dYTttypgdJPpqF6Wm7t7kVjBoWyIpL8TQWVRPTNZsYmWqJiWB9Ydcfuxefq-_Bz7snI3RkxTcOlcqoPYg7CI5C3D_9SDYDHiJk_oiAeSZ-1S8IvOXIKTBzp8P0WUeMG1qYihvMzit_GNI Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: 6b36d14d5bd24ed39bcb0a32dfa016f7 Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-TestShelveInstance-1628523047 Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:37:59.969643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:37:59.979048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_6b36d14d5bd24ed39bcb0a32dfa016f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6b36d14d5bd24ed39bcb0a32dfa016f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/6b36d14d5bd24ed39bcb0a32dfa016f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/6b36d14d5bd24ed39bcb0a32dfa016f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:37:59.979048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-TestShelveInstance-1628523047 Jul 14 14:37:59.979048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: 6b36d14d5bd24ed39bcb0a32dfa016f7 Jul 14 14:37:59.979048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-TestShelveInstance-1628523047 Jul 14 14:37:59.979048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-TestShelveInstance-1628523047-project Jul 14 14:37:59.979048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:37:59.979048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:37:59.979048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: f86340c271b64c14b30834c51a477ca6 Jul 14 14:37:59.979048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-TestShelveInstance-1628523047-project Jul 14 14:37:59.979048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:37:59.979048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 833f486d-a5d2-41ff-8404-19f21892e73c could not be found. Jul 14 14:37:59.979048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '833f486d-a5d2-41ff-8404-19f21892e73c'} Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 833f486d-a5d2-41ff-8404-19f21892e73c could not be found. Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:59.981234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:59.983623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:59.983623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:37:59.983623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:59.983623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:37:59.983623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:59.983623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:59.983623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:59.983623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 833f486d-a5d2-41ff-8404-19f21892e73c could not be found. Jul 14 14:37:59.983623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:59.983623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:59.983623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:59.983623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:59.983623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:59.983623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:59.983623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:59.983623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:59.983623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 833f486d-a5d2-41ff-8404-19f21892e73c could not be found. Jul 14 14:37:59.983623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:37:59.985683 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-82362196-44a1-4718-8aee-7e558c77cef9 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Returning 404 to user: Instance 833f486d-a5d2-41ff-8404-19f21892e73c could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:59.985683 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-82362196-44a1-4718-8aee-7e558c77cef9 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c" status: 404 len: 111 microversion: 2.1 time: 0.030633 Jul 14 14:37:59.985683 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 372/753] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:59 2022] GET /compute/v2.1/servers/833f486d-a5d2-41ff-8404-19f21892e73c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:38:00.281959 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-bf6dc41d-6d95-45da-82de-de4cca38e5d6 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] Calling method '.version_select at 0x7f416c4710d0>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:00.322424 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-cc38d708-073e-46e6-91bf-3b21a61a85d9 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "POST /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.678402 Jul 14 14:38:00.323639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 382/754] 10.222.0.93 () {62 vars in 1363 bytes} [Thu Jul 14 14:37:58 2022] POST /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/os-volume_attachments => generated 188 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:38:00.458185 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-01980f11-e2e7-4538-a34f-5669f5cfe8f5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:00.458775 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-01980f11-e2e7-4538-a34f-5669f5cfe8f5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:00.465272 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-01980f11-e2e7-4538-a34f-5669f5cfe8f5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:00.465704 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-01980f11-e2e7-4538-a34f-5669f5cfe8f5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:00.466513 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-01980f11-e2e7-4538-a34f-5669f5cfe8f5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:00.466935 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-01980f11-e2e7-4538-a34f-5669f5cfe8f5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:00.541133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-bf6dc41d-6d95-45da-82de-de4cca38e5d6 tempest-TestShelveInstance-1628523047 tempest-TestShelveInstance-1628523047-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-461640906" status: 202 len: 0 microversion: 2.1 time: 0.263078 Jul 14 14:38:00.541786 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 373/755] 10.222.0.93 () {58 vars in 1250 bytes} [Thu Jul 14 14:38:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-461640906 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:38:00.821535 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-01980f11-e2e7-4538-a34f-5669f5cfe8f5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "POST /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/action" status: 202 len: 0 microversion: 2.20 time: 0.367239 Jul 14 14:38:00.822468 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 383/756] 10.222.0.93 () {62 vars in 1318 bytes} [Thu Jul 14 14:38:00 2022] POST /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:38:00.830939 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f49e4ee0-a4ed-400d-beb4-aa4cf9655e0b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:00.833560 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f49e4ee0-a4ed-400d-beb4-aa4cf9655e0b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:00.837675 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f49e4ee0-a4ed-400d-beb4-aa4cf9655e0b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:00.838169 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f49e4ee0-a4ed-400d-beb4-aa4cf9655e0b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:00.838926 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f49e4ee0-a4ed-400d-beb4-aa4cf9655e0b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:00.840203 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f49e4ee0-a4ed-400d-beb4-aa4cf9655e0b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:01.094234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f49e4ee0-a4ed-400d-beb4-aa4cf9655e0b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:01.106365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f49e4ee0-a4ed-400d-beb4-aa4cf9655e0b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:01.107971 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f49e4ee0-a4ed-400d-beb4-aa4cf9655e0b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:01.109185 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f49e4ee0-a4ed-400d-beb4-aa4cf9655e0b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1752 microversion: 2.20 time: 0.282181 Jul 14 14:38:01.110151 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 374/757] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:00 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1752 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:02.134491 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-cd0d79f9-1b5f-4ce4-b7be-4bd5655b9865 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:02.136031 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-cd0d79f9-1b5f-4ce4-b7be-4bd5655b9865 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:02.143215 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cd0d79f9-1b5f-4ce4-b7be-4bd5655b9865 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:02.144635 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cd0d79f9-1b5f-4ce4-b7be-4bd5655b9865 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:02.146150 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cd0d79f9-1b5f-4ce4-b7be-4bd5655b9865 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:02.146785 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cd0d79f9-1b5f-4ce4-b7be-4bd5655b9865 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:02.401191 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-cd0d79f9-1b5f-4ce4-b7be-4bd5655b9865 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:02.410862 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-cd0d79f9-1b5f-4ce4-b7be-4bd5655b9865 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:02.412536 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-cd0d79f9-1b5f-4ce4-b7be-4bd5655b9865 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:02.413758 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-cd0d79f9-1b5f-4ce4-b7be-4bd5655b9865 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1752 microversion: 2.20 time: 0.289300 Jul 14 14:38:02.424574 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 384/758] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:02 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1752 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:03.432590 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-94ce50ef-dcdb-48d1-81d0-8cf843441f9a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:03.433900 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-94ce50ef-dcdb-48d1-81d0-8cf843441f9a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:03.440418 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-94ce50ef-dcdb-48d1-81d0-8cf843441f9a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:03.440860 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-94ce50ef-dcdb-48d1-81d0-8cf843441f9a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:03.441809 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-94ce50ef-dcdb-48d1-81d0-8cf843441f9a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:03.442078 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-94ce50ef-dcdb-48d1-81d0-8cf843441f9a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:03.698788 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-94ce50ef-dcdb-48d1-81d0-8cf843441f9a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:03.708741 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-94ce50ef-dcdb-48d1-81d0-8cf843441f9a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:03.711472 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-94ce50ef-dcdb-48d1-81d0-8cf843441f9a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:03.712655 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-94ce50ef-dcdb-48d1-81d0-8cf843441f9a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1754 microversion: 2.20 time: 0.284207 Jul 14 14:38:03.713383 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 375/759] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:03 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1754 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:04.731488 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b2fae742-0a13-4473-b52f-010842e7d34c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:04.733012 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b2fae742-0a13-4473-b52f-010842e7d34c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:04.739596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b2fae742-0a13-4473-b52f-010842e7d34c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:04.740045 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b2fae742-0a13-4473-b52f-010842e7d34c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:04.754754 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b2fae742-0a13-4473-b52f-010842e7d34c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:04.755215 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b2fae742-0a13-4473-b52f-010842e7d34c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:04.892277 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b2fae742-0a13-4473-b52f-010842e7d34c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:04.901503 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b2fae742-0a13-4473-b52f-010842e7d34c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:04.902926 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b2fae742-0a13-4473-b52f-010842e7d34c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:04.904089 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b2fae742-0a13-4473-b52f-010842e7d34c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1754 microversion: 2.20 time: 0.177408 Jul 14 14:38:04.904642 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 385/760] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:04 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:05.922896 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-451e14e0-9337-4fc9-8310-08ed6fbfa1f0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:05.923504 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-451e14e0-9337-4fc9-8310-08ed6fbfa1f0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:05.930636 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-451e14e0-9337-4fc9-8310-08ed6fbfa1f0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:05.937530 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-451e14e0-9337-4fc9-8310-08ed6fbfa1f0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:05.937530 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-451e14e0-9337-4fc9-8310-08ed6fbfa1f0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:05.937530 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-451e14e0-9337-4fc9-8310-08ed6fbfa1f0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:06.236749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-451e14e0-9337-4fc9-8310-08ed6fbfa1f0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:06.250892 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-451e14e0-9337-4fc9-8310-08ed6fbfa1f0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:06.254282 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-451e14e0-9337-4fc9-8310-08ed6fbfa1f0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:06.255496 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-451e14e0-9337-4fc9-8310-08ed6fbfa1f0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1810 microversion: 2.20 time: 0.336656 Jul 14 14:38:06.257819 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 376/761] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:05 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1810 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:07.274405 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0f4b4dc5-1847-4186-92dc-57bb28910be0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:07.275745 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-0f4b4dc5-1847-4186-92dc-57bb28910be0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:07.283712 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:07.286414 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0f4b4dc5-1847-4186-92dc-57bb28910be0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:07.286932 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0f4b4dc5-1847-4186-92dc-57bb28910be0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:07.287860 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0f4b4dc5-1847-4186-92dc-57bb28910be0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:07.288694 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0f4b4dc5-1847-4186-92dc-57bb28910be0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:07.605389 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-0f4b4dc5-1847-4186-92dc-57bb28910be0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:07.614901 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-0f4b4dc5-1847-4186-92dc-57bb28910be0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:07.619550 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-0f4b4dc5-1847-4186-92dc-57bb28910be0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:07.622447 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-0f4b4dc5-1847-4186-92dc-57bb28910be0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1810 microversion: 2.20 time: 0.351645 Jul 14 14:38:07.622638 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 386/762] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:07 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1810 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:08.642391 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-71082f5e-d79a-42c3-9c4d-d766f72ad138 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:08.643657 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-71082f5e-d79a-42c3-9c4d-d766f72ad138 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:08.655243 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-71082f5e-d79a-42c3-9c4d-d766f72ad138 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:08.656541 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-71082f5e-d79a-42c3-9c4d-d766f72ad138 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:08.659074 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-71082f5e-d79a-42c3-9c4d-d766f72ad138 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:08.660988 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-71082f5e-d79a-42c3-9c4d-d766f72ad138 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:08.948965 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-71082f5e-d79a-42c3-9c4d-d766f72ad138 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:08.968279 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-71082f5e-d79a-42c3-9c4d-d766f72ad138 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:08.969811 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-71082f5e-d79a-42c3-9c4d-d766f72ad138 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:08.979673 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-71082f5e-d79a-42c3-9c4d-d766f72ad138 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1810 microversion: 2.20 time: 0.342221 Jul 14 14:38:08.991121 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 377/763] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:08 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1810 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:09.999293 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f52779f8-3308-4cd7-8ff1-bd811c6a62f4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:10.000001 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-f52779f8-3308-4cd7-8ff1-bd811c6a62f4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:10.006894 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f52779f8-3308-4cd7-8ff1-bd811c6a62f4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:10.010270 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f52779f8-3308-4cd7-8ff1-bd811c6a62f4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:10.010270 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f52779f8-3308-4cd7-8ff1-bd811c6a62f4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:10.010270 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f52779f8-3308-4cd7-8ff1-bd811c6a62f4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:10.168131 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-f52779f8-3308-4cd7-8ff1-bd811c6a62f4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:10.177212 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-f52779f8-3308-4cd7-8ff1-bd811c6a62f4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:10.178888 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-f52779f8-3308-4cd7-8ff1-bd811c6a62f4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:10.191245 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-f52779f8-3308-4cd7-8ff1-bd811c6a62f4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1810 microversion: 2.20 time: 0.196511 Jul 14 14:38:10.191858 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 387/764] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:09 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1810 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:11.209708 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-245b6526-ad20-42de-8819-0e90f230e9d4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:11.210409 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-245b6526-ad20-42de-8819-0e90f230e9d4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:11.217103 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-245b6526-ad20-42de-8819-0e90f230e9d4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:11.235161 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-245b6526-ad20-42de-8819-0e90f230e9d4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:11.235161 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-245b6526-ad20-42de-8819-0e90f230e9d4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:11.235161 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-245b6526-ad20-42de-8819-0e90f230e9d4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:11.361836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-245b6526-ad20-42de-8819-0e90f230e9d4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:11.371566 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-245b6526-ad20-42de-8819-0e90f230e9d4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:11.373119 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-245b6526-ad20-42de-8819-0e90f230e9d4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:11.374329 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-245b6526-ad20-42de-8819-0e90f230e9d4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1810 microversion: 2.20 time: 0.168520 Jul 14 14:38:11.375065 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 378/765] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:11 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:12.393323 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-1113f00b-352c-43fc-9bc6-ceb37219da2a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:12.394290 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-1113f00b-352c-43fc-9bc6-ceb37219da2a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:12.407452 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1113f00b-352c-43fc-9bc6-ceb37219da2a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:12.408002 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1113f00b-352c-43fc-9bc6-ceb37219da2a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:12.408864 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1113f00b-352c-43fc-9bc6-ceb37219da2a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:12.409363 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1113f00b-352c-43fc-9bc6-ceb37219da2a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:12.589207 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-1113f00b-352c-43fc-9bc6-ceb37219da2a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:12.599303 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-1113f00b-352c-43fc-9bc6-ceb37219da2a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:12.601053 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-1113f00b-352c-43fc-9bc6-ceb37219da2a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:12.602338 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-1113f00b-352c-43fc-9bc6-ceb37219da2a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1810 microversion: 2.20 time: 0.213126 Jul 14 14:38:12.602884 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 388/766] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:12 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1810 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:13.621188 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7abbe075-baa0-4c03-b696-be06f6fe7bf1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:13.621840 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-7abbe075-baa0-4c03-b696-be06f6fe7bf1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:13.628601 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7abbe075-baa0-4c03-b696-be06f6fe7bf1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:13.629035 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7abbe075-baa0-4c03-b696-be06f6fe7bf1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:13.629812 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7abbe075-baa0-4c03-b696-be06f6fe7bf1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:13.630239 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7abbe075-baa0-4c03-b696-be06f6fe7bf1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:13.776923 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7abbe075-baa0-4c03-b696-be06f6fe7bf1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:13.785578 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7abbe075-baa0-4c03-b696-be06f6fe7bf1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:13.787109 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7abbe075-baa0-4c03-b696-be06f6fe7bf1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:13.811527 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-7abbe075-baa0-4c03-b696-be06f6fe7bf1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1810 microversion: 2.20 time: 0.171706 Jul 14 14:38:13.811527 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 379/767] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:13 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:14.829527 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-480ba13d-12b0-4f99-8644-fb98e2642f8f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:14.830199 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-480ba13d-12b0-4f99-8644-fb98e2642f8f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:14.837119 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-480ba13d-12b0-4f99-8644-fb98e2642f8f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:14.837562 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-480ba13d-12b0-4f99-8644-fb98e2642f8f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:14.838369 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-480ba13d-12b0-4f99-8644-fb98e2642f8f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:14.838898 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-480ba13d-12b0-4f99-8644-fb98e2642f8f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:14.984002 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-480ba13d-12b0-4f99-8644-fb98e2642f8f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:14.996597 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-480ba13d-12b0-4f99-8644-fb98e2642f8f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:14.998158 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-480ba13d-12b0-4f99-8644-fb98e2642f8f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:14.999353 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-480ba13d-12b0-4f99-8644-fb98e2642f8f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1810 microversion: 2.20 time: 0.174341 Jul 14 14:38:14.999936 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 389/768] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:14 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:16.017813 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c09e0c43-8118-43cd-b4c4-7ab92ac7d443 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:16.018421 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c09e0c43-8118-43cd-b4c4-7ab92ac7d443 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:16.025045 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c09e0c43-8118-43cd-b4c4-7ab92ac7d443 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:16.025725 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c09e0c43-8118-43cd-b4c4-7ab92ac7d443 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:16.026893 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c09e0c43-8118-43cd-b4c4-7ab92ac7d443 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:16.027329 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c09e0c43-8118-43cd-b4c4-7ab92ac7d443 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:16.158083 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-c09e0c43-8118-43cd-b4c4-7ab92ac7d443 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:16.160264 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=100 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:16.166973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-c09e0c43-8118-43cd-b4c4-7ab92ac7d443 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:16.173214 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-c09e0c43-8118-43cd-b4c4-7ab92ac7d443 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:16.173214 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c09e0c43-8118-43cd-b4c4-7ab92ac7d443 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1810 microversion: 2.20 time: 0.155781 Jul 14 14:38:16.173214 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 380/769] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:16 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:17.187599 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-1ac5b214-4c8f-4d1f-b136-7de64cc77d54 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:17.188182 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-1ac5b214-4c8f-4d1f-b136-7de64cc77d54 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:17.195525 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1ac5b214-4c8f-4d1f-b136-7de64cc77d54 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:17.195967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1ac5b214-4c8f-4d1f-b136-7de64cc77d54 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:17.196722 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1ac5b214-4c8f-4d1f-b136-7de64cc77d54 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:17.197151 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1ac5b214-4c8f-4d1f-b136-7de64cc77d54 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:17.216519 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:INSERT=5,nova_cell1:SELECT=90,nova_cell1:UPDATE=5 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:17.330243 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-1ac5b214-4c8f-4d1f-b136-7de64cc77d54 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:17.338740 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-1ac5b214-4c8f-4d1f-b136-7de64cc77d54 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:17.340752 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-1ac5b214-4c8f-4d1f-b136-7de64cc77d54 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:17.341938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-1ac5b214-4c8f-4d1f-b136-7de64cc77d54 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1810 microversion: 2.20 time: 0.158254 Jul 14 14:38:17.342486 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 390/770] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:17 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:18.360711 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-49284326-bd01-4222-af5f-5fba6369f833 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:18.361257 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-49284326-bd01-4222-af5f-5fba6369f833 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:18.367658 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-49284326-bd01-4222-af5f-5fba6369f833 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.368096 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-49284326-bd01-4222-af5f-5fba6369f833 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.368839 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-49284326-bd01-4222-af5f-5fba6369f833 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.369262 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-49284326-bd01-4222-af5f-5fba6369f833 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.497592 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-49284326-bd01-4222-af5f-5fba6369f833 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:18.506051 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-49284326-bd01-4222-af5f-5fba6369f833 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:18.507568 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-49284326-bd01-4222-af5f-5fba6369f833 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:18.508717 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-49284326-bd01-4222-af5f-5fba6369f833 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1810 microversion: 2.20 time: 0.152365 Jul 14 14:38:18.509283 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 381/771] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:18 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:19.528721 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a313516a-b8fa-43a0-b25f-49d1175c6eb6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:19.529581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a313516a-b8fa-43a0-b25f-49d1175c6eb6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:19.537144 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a313516a-b8fa-43a0-b25f-49d1175c6eb6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:19.537847 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a313516a-b8fa-43a0-b25f-49d1175c6eb6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:19.538651 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a313516a-b8fa-43a0-b25f-49d1175c6eb6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:19.539111 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a313516a-b8fa-43a0-b25f-49d1175c6eb6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:19.679809 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a313516a-b8fa-43a0-b25f-49d1175c6eb6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:19.687580 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a313516a-b8fa-43a0-b25f-49d1175c6eb6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:19.689068 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a313516a-b8fa-43a0-b25f-49d1175c6eb6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:19.690271 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a313516a-b8fa-43a0-b25f-49d1175c6eb6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1810 microversion: 2.20 time: 0.166535 Jul 14 14:38:19.690832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 391/772] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:19 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:20.708448 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a18c7455-6f2f-48dc-96b1-84fde75d2a90 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:20.709028 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a18c7455-6f2f-48dc-96b1-84fde75d2a90 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:20.715978 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a18c7455-6f2f-48dc-96b1-84fde75d2a90 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:20.716412 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a18c7455-6f2f-48dc-96b1-84fde75d2a90 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:20.717156 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a18c7455-6f2f-48dc-96b1-84fde75d2a90 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:20.717582 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a18c7455-6f2f-48dc-96b1-84fde75d2a90 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:20.845036 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a18c7455-6f2f-48dc-96b1-84fde75d2a90 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:20.853420 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a18c7455-6f2f-48dc-96b1-84fde75d2a90 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:20.855891 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a18c7455-6f2f-48dc-96b1-84fde75d2a90 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:20.857053 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a18c7455-6f2f-48dc-96b1-84fde75d2a90 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1810 microversion: 2.20 time: 0.152516 Jul 14 14:38:20.857610 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 382/773] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:20 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:38:21.876640 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c0e77eee-87ad-4f07-8529-f3ee01bf28fc tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:21.877240 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c0e77eee-87ad-4f07-8529-f3ee01bf28fc tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:21.883581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c0e77eee-87ad-4f07-8529-f3ee01bf28fc tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:21.883829 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c0e77eee-87ad-4f07-8529-f3ee01bf28fc tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:21.884585 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c0e77eee-87ad-4f07-8529-f3ee01bf28fc tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:21.885140 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c0e77eee-87ad-4f07-8529-f3ee01bf28fc tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:21.999005 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e3d0fb65-3b40-45d8-920a-c212cff56601 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:21.999636 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e3d0fb65-3b40-45d8-920a-c212cff56601 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:22.005911 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e3d0fb65-3b40-45d8-920a-c212cff56601 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:22.006348 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e3d0fb65-3b40-45d8-920a-c212cff56601 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:22.007098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e3d0fb65-3b40-45d8-920a-c212cff56601 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:22.007529 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e3d0fb65-3b40-45d8-920a-c212cff56601 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:22.019633 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c0e77eee-87ad-4f07-8529-f3ee01bf28fc tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:22.028393 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c0e77eee-87ad-4f07-8529-f3ee01bf28fc tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:22.030036 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c0e77eee-87ad-4f07-8529-f3ee01bf28fc tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:22.031221 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c0e77eee-87ad-4f07-8529-f3ee01bf28fc tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1810 microversion: 2.20 time: 0.159078 Jul 14 14:38:22.031772 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 392/774] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:21 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:22.033489 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e3d0fb65-3b40-45d8-920a-c212cff56601 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580/ips" status: 200 len: 149 microversion: 2.1 time: 0.038832 Jul 14 14:38:22.034084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 383/775] 10.222.0.93 () {58 vars in 1247 bytes} [Thu Jul 14 14:38:21 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:38:23.051629 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b0fcd68e-2dfd-491a-a4cb-48fa93641824 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:23.052314 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b0fcd68e-2dfd-491a-a4cb-48fa93641824 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:23.059665 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b0fcd68e-2dfd-491a-a4cb-48fa93641824 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:23.060108 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b0fcd68e-2dfd-491a-a4cb-48fa93641824 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:23.060875 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b0fcd68e-2dfd-491a-a4cb-48fa93641824 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:23.061307 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b0fcd68e-2dfd-491a-a4cb-48fa93641824 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:23.190116 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b0fcd68e-2dfd-491a-a4cb-48fa93641824 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:23.198915 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b0fcd68e-2dfd-491a-a4cb-48fa93641824 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:23.205393 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b0fcd68e-2dfd-491a-a4cb-48fa93641824 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:23.205393 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b0fcd68e-2dfd-491a-a4cb-48fa93641824 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1810 microversion: 2.20 time: 0.155291 Jul 14 14:38:23.205393 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 393/776] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:23 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:23.502498 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-76910c40-c044-4fd0-aae6-9f9318d166ee req-dbf550e4-2c1f-4859-87b3-a71e4b0355d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d810a21-86d3-4d18-b9d6-eae39990ac26", "name": "network-vif-plugged", "status": "completed", "tag": "56e9cb11-f5b0-4131-82d8-c97417b17d2c"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:23.511236 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-76910c40-c044-4fd0-aae6-9f9318d166ee req-dbf550e4-2c1f-4859-87b3-a71e4b0355d5 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:23.511773 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-76910c40-c044-4fd0-aae6-9f9318d166ee req-dbf550e4-2c1f-4859-87b3-a71e4b0355d5 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:23.522565 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-76910c40-c044-4fd0-aae6-9f9318d166ee req-dbf550e4-2c1f-4859-87b3-a71e4b0355d5 service nova] Creating event network-vif-plugged:56e9cb11-f5b0-4131-82d8-c97417b17d2c for instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 on hv-cinder-79987 Jul 14 14:38:23.527751 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-76910c40-c044-4fd0-aae6-9f9318d166ee req-dbf550e4-2c1f-4859-87b3-a71e4b0355d5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028951 Jul 14 14:38:23.528327 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 384/777] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:23.841051 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b37a52af-65f2-4724-8a34-766766ecb22b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcadb717-ef62-4a55-a8b8-77b89a65c772"}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:23.842214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b37a52af-65f2-4724-8a34-766766ecb22b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:23.848212 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b37a52af-65f2-4724-8a34-766766ecb22b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:23.848650 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b37a52af-65f2-4724-8a34-766766ecb22b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:23.849393 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b37a52af-65f2-4724-8a34-766766ecb22b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:23.849863 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b37a52af-65f2-4724-8a34-766766ecb22b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:24.220741 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-2486ca31-84d7-4880-aaa0-265ebc134dc5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:24.221809 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-2486ca31-84d7-4880-aaa0-265ebc134dc5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:24.228357 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2486ca31-84d7-4880-aaa0-265ebc134dc5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:24.228795 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2486ca31-84d7-4880-aaa0-265ebc134dc5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:24.229842 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2486ca31-84d7-4880-aaa0-265ebc134dc5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:24.230362 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2486ca31-84d7-4880-aaa0-265ebc134dc5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:24.359662 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-2486ca31-84d7-4880-aaa0-265ebc134dc5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:24.368066 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-2486ca31-84d7-4880-aaa0-265ebc134dc5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:24.369615 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-2486ca31-84d7-4880-aaa0-265ebc134dc5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:24.370809 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-2486ca31-84d7-4880-aaa0-265ebc134dc5 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1810 microversion: 2.20 time: 0.154476 Jul 14 14:38:24.371396 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 385/778] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:24 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:24.829362 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b37a52af-65f2-4724-8a34-766766ecb22b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "POST /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.992666 Jul 14 14:38:24.830011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 394/779] 10.222.0.93 () {60 vars in 1322 bytes} [Thu Jul 14 14:38:23 2022] POST /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580/os-volume_attachments => generated 194 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:25.389341 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ad2619fd-0de9-4e67-af0c-93862e85e190 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:25.389988 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ad2619fd-0de9-4e67-af0c-93862e85e190 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:25.396040 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ad2619fd-0de9-4e67-af0c-93862e85e190 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:25.396427 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ad2619fd-0de9-4e67-af0c-93862e85e190 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:25.397255 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ad2619fd-0de9-4e67-af0c-93862e85e190 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:25.397684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ad2619fd-0de9-4e67-af0c-93862e85e190 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:25.534002 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ad2619fd-0de9-4e67-af0c-93862e85e190 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:25.543525 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ad2619fd-0de9-4e67-af0c-93862e85e190 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:25.547230 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ad2619fd-0de9-4e67-af0c-93862e85e190 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:25.547230 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ad2619fd-0de9-4e67-af0c-93862e85e190 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1810 microversion: 2.20 time: 0.161674 Jul 14 14:38:25.547230 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 386/780] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:25 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:26.565537 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-12d892d0-3771-4670-a9aa-d4d27cfb8ac7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:26.566255 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-12d892d0-3771-4670-a9aa-d4d27cfb8ac7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:26.572547 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-12d892d0-3771-4670-a9aa-d4d27cfb8ac7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:26.572995 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-12d892d0-3771-4670-a9aa-d4d27cfb8ac7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:26.573755 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-12d892d0-3771-4670-a9aa-d4d27cfb8ac7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:26.574331 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-12d892d0-3771-4670-a9aa-d4d27cfb8ac7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:26.707129 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-12d892d0-3771-4670-a9aa-d4d27cfb8ac7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:26.716521 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-12d892d0-3771-4670-a9aa-d4d27cfb8ac7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:26.718120 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-12d892d0-3771-4670-a9aa-d4d27cfb8ac7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:26.719279 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-12d892d0-3771-4670-a9aa-d4d27cfb8ac7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1810 microversion: 2.20 time: 0.158696 Jul 14 14:38:26.719843 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 395/781] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:26 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:27.738321 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d33a14c5-9305-48d7-81e5-51213e1b0d5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:27.738929 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-d33a14c5-9305-48d7-81e5-51213e1b0d5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:27.741436 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:27.746758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d33a14c5-9305-48d7-81e5-51213e1b0d5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:27.747208 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d33a14c5-9305-48d7-81e5-51213e1b0d5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:27.747973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d33a14c5-9305-48d7-81e5-51213e1b0d5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:27.748408 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d33a14c5-9305-48d7-81e5-51213e1b0d5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:27.877210 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-d33a14c5-9305-48d7-81e5-51213e1b0d5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:27.885685 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-d33a14c5-9305-48d7-81e5-51213e1b0d5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:27.887358 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-d33a14c5-9305-48d7-81e5-51213e1b0d5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:27.888511 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-d33a14c5-9305-48d7-81e5-51213e1b0d5f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1797 microversion: 2.20 time: 0.154172 Jul 14 14:38:27.889064 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 387/782] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:27 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1797 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:32.343506 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ca57f707-45c0-41f9-8fd6-d3652cf784a4 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Action: 'create', calling method: .version_select at 0x7f415fbbde50>, body: {"keypair": {"name": "tempest-keypair-784768117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFaujzMnHd409nh1tI/YVSylX6eZxOYLvewMpJXtKjYQ+LdvNfE6Tr4sZmIMZHaKAuU/IB8BuU7Ucxp68sm4R8Wt+Jz5z8H2cRG2L3iqazLlwoHNmwrSbg680cgGj2GKg=="}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:32.358295 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-ca57f707-45c0-41f9-8fd6-d3652cf784a4 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Getting quotas for project abb12869989f45cc875ecb36dd1f7aef. Resources: {'key_pairs'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:38:32.362172 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-ca57f707-45c0-41f9-8fd6-d3652cf784a4 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Getting quotas for user 98f00ffeef484dd489ed67b96d1ed783 and project abb12869989f45cc875ecb36dd1f7aef. Resources: {'key_pairs'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:38:32.495296 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-ca57f707-45c0-41f9-8fd6-d3652cf784a4 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.155318 Jul 14 14:38:32.496397 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 396/783] 10.222.0.93 () {60 vars in 1158 bytes} [Thu Jul 14 14:38:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:35.172855 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-383c8d13-7181-46d4-996f-d76ebd0e75db tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-804255693", "imageRef": "7ea875a4-facb-4053-be2d-ff0080d2f3a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e31486e8-2bc1-4f00-b9ce-bbd86c605e0f"}], "security_groups": [{"name": "tempest-securitygroup--1921639470"}], "key_name": "tempest-keypair-784768117", "user_data": "}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:35.275168 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.network.neutron [None req-383c8d13-7181-46d4-996f-d76ebd0e75db tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] validate_networks() for [('e31486e8-2bc1-4f00-b9ce-bbd86c605e0f', None, None, None, None, None)] {{(pid=118462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:38:35.639299 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-383c8d13-7181-46d4-996f-d76ebd0e75db tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Flavor limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:38:35.639721 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-383c8d13-7181-46d4-996f-d76ebd0e75db tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Image limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:38:35.640194 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-383c8d13-7181-46d4-996f-d76ebd0e75db tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Flavor pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:38:35.640598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-383c8d13-7181-46d4-996f-d76ebd0e75db tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Image pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:38:35.641004 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-383c8d13-7181-46d4-996f-d76ebd0e75db tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:38:35.649929 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-383c8d13-7181-46d4-996f-d76ebd0e75db tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:35.650373 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-383c8d13-7181-46d4-996f-d76ebd0e75db tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:35.651159 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-383c8d13-7181-46d4-996f-d76ebd0e75db tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:35.651595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-383c8d13-7181-46d4-996f-d76ebd0e75db tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:35.669077 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-383c8d13-7181-46d4-996f-d76ebd0e75db tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Getting quotas for project abb12869989f45cc875ecb36dd1f7aef. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:38:35.672970 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-383c8d13-7181-46d4-996f-d76ebd0e75db tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Getting quotas for user 98f00ffeef484dd489ed67b96d1ed783 and project abb12869989f45cc875ecb36dd1f7aef. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:38:35.684564 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-383c8d13-7181-46d4-996f-d76ebd0e75db tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Going to run 1 instances... {{(pid=118462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:38:35.686830 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-383c8d13-7181-46d4-996f-d76ebd0e75db tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ea875a4-facb-4053-be2d-ff0080d2f3a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:38:35.890166 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-383c8d13-7181-46d4-996f-d76ebd0e75db tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.721339 Jul 14 14:38:35.890720 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 388/784] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:38:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:38:35.901191 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-db3a0142-5a66-4f42-af06-72fdbe661291 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:35.901895 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-db3a0142-5a66-4f42-af06-72fdbe661291 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:35.955098 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-db3a0142-5a66-4f42-af06-72fdbe661291 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:35.963629 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-db3a0142-5a66-4f42-af06-72fdbe661291 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 200 len: 1240 microversion: 2.1 time: 0.066405 Jul 14 14:38:35.964203 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 397/785] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:35 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:36.981890 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f4029a31-24ef-4bb3-b5df-c4f988b0e2b5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:36.982288 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f4029a31-24ef-4bb3-b5df-c4f988b0e2b5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:37.035474 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f4029a31-24ef-4bb3-b5df-c4f988b0e2b5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:37.043051 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f4029a31-24ef-4bb3-b5df-c4f988b0e2b5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 200 len: 1240 microversion: 2.1 time: 0.066514 Jul 14 14:38:37.043672 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 389/786] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:36 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:38.060475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-98cc632e-1d63-43ab-a4d9-43181636fb08 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:38.061080 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-98cc632e-1d63-43ab-a4d9-43181636fb08 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:38.063450 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:38.064243 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:38.069062 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-98cc632e-1d63-43ab-a4d9-43181636fb08 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:38.069511 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-98cc632e-1d63-43ab-a4d9-43181636fb08 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:38.070409 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-98cc632e-1d63-43ab-a4d9-43181636fb08 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:38.070826 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-98cc632e-1d63-43ab-a4d9-43181636fb08 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:38.135761 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-98cc632e-1d63-43ab-a4d9-43181636fb08 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:38.143486 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-98cc632e-1d63-43ab-a4d9-43181636fb08 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 200 len: 1244 microversion: 2.1 time: 0.087548 Jul 14 14:38:38.144075 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 398/787] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:38 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:39.160442 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e5a9faf1-25f9-4834-8880-52f0d031611f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:39.161085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e5a9faf1-25f9-4834-8880-52f0d031611f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:39.167678 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e5a9faf1-25f9-4834-8880-52f0d031611f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:39.168125 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e5a9faf1-25f9-4834-8880-52f0d031611f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:39.168898 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e5a9faf1-25f9-4834-8880-52f0d031611f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:39.169333 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e5a9faf1-25f9-4834-8880-52f0d031611f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:39.238947 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e5a9faf1-25f9-4834-8880-52f0d031611f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:39.247529 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e5a9faf1-25f9-4834-8880-52f0d031611f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 200 len: 1300 microversion: 2.1 time: 0.090803 Jul 14 14:38:39.248471 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 390/788] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:39 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:40.265618 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e9677f10-0a60-4461-8f0f-6db6c17fe510 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:40.266197 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e9677f10-0a60-4461-8f0f-6db6c17fe510 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:40.273845 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e9677f10-0a60-4461-8f0f-6db6c17fe510 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:40.276132 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e9677f10-0a60-4461-8f0f-6db6c17fe510 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:40.276132 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e9677f10-0a60-4461-8f0f-6db6c17fe510 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:40.276132 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e9677f10-0a60-4461-8f0f-6db6c17fe510 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:40.406407 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e9677f10-0a60-4461-8f0f-6db6c17fe510 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:40.414072 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e9677f10-0a60-4461-8f0f-6db6c17fe510 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 200 len: 1366 microversion: 2.1 time: 0.153541 Jul 14 14:38:40.414744 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 399/789] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:40 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:40.877528 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-040e8a37-309a-4fee-990c-1cfa3de55779 req-0b20875b-f4c3-4020-b67e-34a8e0fea766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5de64b-6114-45a7-8460-9c4379efd920", "tag": "1570e8e0-72d4-4af1-9343-59fc9f178c6f"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:40.887639 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-040e8a37-309a-4fee-990c-1cfa3de55779 req-0b20875b-f4c3-4020-b67e-34a8e0fea766 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:40.887969 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-040e8a37-309a-4fee-990c-1cfa3de55779 req-0b20875b-f4c3-4020-b67e-34a8e0fea766 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:40.904361 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-040e8a37-309a-4fee-990c-1cfa3de55779 req-0b20875b-f4c3-4020-b67e-34a8e0fea766 service nova] Creating event network-changed:1570e8e0-72d4-4af1-9343-59fc9f178c6f for instance 0e5de64b-6114-45a7-8460-9c4379efd920 on hv-cinder-79987 Jul 14 14:38:40.909603 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-040e8a37-309a-4fee-990c-1cfa3de55779 req-0b20875b-f4c3-4020-b67e-34a8e0fea766 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035681 Jul 14 14:38:40.910412 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 391/790] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:41.431087 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-bf974ab9-7130-44b4-b2ed-dacf1f273a16 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:41.431689 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-bf974ab9-7130-44b4-b2ed-dacf1f273a16 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:41.439076 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bf974ab9-7130-44b4-b2ed-dacf1f273a16 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:41.439510 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bf974ab9-7130-44b4-b2ed-dacf1f273a16 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:41.440259 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bf974ab9-7130-44b4-b2ed-dacf1f273a16 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:41.440680 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bf974ab9-7130-44b4-b2ed-dacf1f273a16 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:41.572777 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-bf974ab9-7130-44b4-b2ed-dacf1f273a16 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:41.580819 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-bf974ab9-7130-44b4-b2ed-dacf1f273a16 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 200 len: 1366 microversion: 2.1 time: 0.153697 Jul 14 14:38:41.581393 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 400/791] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:41 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:42.599424 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-3b1a2da3-2f3d-4ee5-b7e6-4d315ae69fac tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:42.600273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-3b1a2da3-2f3d-4ee5-b7e6-4d315ae69fac tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:42.606858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3b1a2da3-2f3d-4ee5-b7e6-4d315ae69fac tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:42.607304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3b1a2da3-2f3d-4ee5-b7e6-4d315ae69fac tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:42.608056 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3b1a2da3-2f3d-4ee5-b7e6-4d315ae69fac tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:42.608491 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3b1a2da3-2f3d-4ee5-b7e6-4d315ae69fac tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:42.740396 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-3b1a2da3-2f3d-4ee5-b7e6-4d315ae69fac tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:42.747789 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-3b1a2da3-2f3d-4ee5-b7e6-4d315ae69fac tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 200 len: 1366 microversion: 2.1 time: 0.153175 Jul 14 14:38:42.748348 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 392/792] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:42 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:43.764625 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b4ea3670-4445-476f-b6ca-5f3187f29263 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:43.765169 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b4ea3670-4445-476f-b6ca-5f3187f29263 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:43.771682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b4ea3670-4445-476f-b6ca-5f3187f29263 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:43.772128 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b4ea3670-4445-476f-b6ca-5f3187f29263 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:43.772886 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b4ea3670-4445-476f-b6ca-5f3187f29263 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:43.773320 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b4ea3670-4445-476f-b6ca-5f3187f29263 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:43.902418 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b4ea3670-4445-476f-b6ca-5f3187f29263 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:43.910109 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b4ea3670-4445-476f-b6ca-5f3187f29263 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 200 len: 1366 microversion: 2.1 time: 0.150080 Jul 14 14:38:43.910672 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 401/793] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:43 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:44.927396 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-1f048208-b636-4bfa-b367-101861c31ddb tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:44.928151 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-1f048208-b636-4bfa-b367-101861c31ddb tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:44.935776 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1f048208-b636-4bfa-b367-101861c31ddb tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:44.936225 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1f048208-b636-4bfa-b367-101861c31ddb tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:44.936989 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1f048208-b636-4bfa-b367-101861c31ddb tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:44.937422 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1f048208-b636-4bfa-b367-101861c31ddb tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:45.074990 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-1f048208-b636-4bfa-b367-101861c31ddb tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:45.082485 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-1f048208-b636-4bfa-b367-101861c31ddb tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 200 len: 1366 microversion: 2.1 time: 0.159003 Jul 14 14:38:45.083059 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 393/794] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:44 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:45.770656 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-96cc3855-131f-4ab0-b046-c6a6a54075fd req-9d0a4d44-949a-4011-ba93-85e632d90cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5de64b-6114-45a7-8460-9c4379efd920", "name": "network-vif-plugged", "status": "completed", "tag": "1570e8e0-72d4-4af1-9343-59fc9f178c6f"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:45.780526 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-96cc3855-131f-4ab0-b046-c6a6a54075fd req-9d0a4d44-949a-4011-ba93-85e632d90cf7 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:45.781034 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-96cc3855-131f-4ab0-b046-c6a6a54075fd req-9d0a4d44-949a-4011-ba93-85e632d90cf7 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:45.792541 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-96cc3855-131f-4ab0-b046-c6a6a54075fd req-9d0a4d44-949a-4011-ba93-85e632d90cf7 service nova] Creating event network-vif-plugged:1570e8e0-72d4-4af1-9343-59fc9f178c6f for instance 0e5de64b-6114-45a7-8460-9c4379efd920 on hv-cinder-79987 Jul 14 14:38:45.797966 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-96cc3855-131f-4ab0-b046-c6a6a54075fd req-9d0a4d44-949a-4011-ba93-85e632d90cf7 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031011 Jul 14 14:38:45.798602 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 402/795] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:46.098976 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-84ff3db6-d051-46a8-9184-f4c96e3183f6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:46.099586 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-84ff3db6-d051-46a8-9184-f4c96e3183f6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:46.101585 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=2 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:46.107522 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-84ff3db6-d051-46a8-9184-f4c96e3183f6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.107973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-84ff3db6-d051-46a8-9184-f4c96e3183f6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.108737 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-84ff3db6-d051-46a8-9184-f4c96e3183f6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.109171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-84ff3db6-d051-46a8-9184-f4c96e3183f6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.242052 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-84ff3db6-d051-46a8-9184-f4c96e3183f6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:46.250279 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-84ff3db6-d051-46a8-9184-f4c96e3183f6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 200 len: 1366 microversion: 2.1 time: 0.155071 Jul 14 14:38:46.250862 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 394/796] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:46 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:47.264761 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=6 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:47.269397 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a7ba6b83-eeba-40b8-a5c3-1575089a5eb0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:47.270222 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a7ba6b83-eeba-40b8-a5c3-1575089a5eb0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:47.276563 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a7ba6b83-eeba-40b8-a5c3-1575089a5eb0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.283333 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a7ba6b83-eeba-40b8-a5c3-1575089a5eb0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.283333 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a7ba6b83-eeba-40b8-a5c3-1575089a5eb0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.283333 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a7ba6b83-eeba-40b8-a5c3-1575089a5eb0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.413298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a7ba6b83-eeba-40b8-a5c3-1575089a5eb0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:47.420841 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a7ba6b83-eeba-40b8-a5c3-1575089a5eb0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 200 len: 1366 microversion: 2.1 time: 0.156975 Jul 14 14:38:47.430742 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 403/797] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:47 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:48.438243 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b00a2cea-3a85-4aa2-888e-9e301a75f4b7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:48.438827 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b00a2cea-3a85-4aa2-888e-9e301a75f4b7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:48.440655 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=8 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:48.446105 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b00a2cea-3a85-4aa2-888e-9e301a75f4b7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:48.446549 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b00a2cea-3a85-4aa2-888e-9e301a75f4b7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:48.447312 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b00a2cea-3a85-4aa2-888e-9e301a75f4b7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:48.447742 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b00a2cea-3a85-4aa2-888e-9e301a75f4b7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:48.452496 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=66 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:48.575666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b00a2cea-3a85-4aa2-888e-9e301a75f4b7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:48.583162 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b00a2cea-3a85-4aa2-888e-9e301a75f4b7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 200 len: 1555 microversion: 2.1 time: 0.149415 Jul 14 14:38:48.583734 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 395/798] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:48 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:48.599843 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c5cf7e03-e111-4537-8b89-43a8db3bcaba tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:48.600381 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c5cf7e03-e111-4537-8b89-43a8db3bcaba tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:48.607046 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c5cf7e03-e111-4537-8b89-43a8db3bcaba tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:48.607487 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c5cf7e03-e111-4537-8b89-43a8db3bcaba tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:48.608232 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c5cf7e03-e111-4537-8b89-43a8db3bcaba tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:48.608661 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c5cf7e03-e111-4537-8b89-43a8db3bcaba tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:48.683519 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c5cf7e03-e111-4537-8b89-43a8db3bcaba tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087508 Jul 14 14:38:48.684106 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 404/799] 10.222.0.93 () {58 vars in 1274 bytes} [Thu Jul 14 14:38:48 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:49.944836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-6c69690e-8e8e-47e4-93a1-29b5f243e056 req-d602bac0-e5be-4a2d-be1c-a5fdd840501b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5de64b-6114-45a7-8460-9c4379efd920", "tag": "1570e8e0-72d4-4af1-9343-59fc9f178c6f"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:49.954639 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-6c69690e-8e8e-47e4-93a1-29b5f243e056 req-d602bac0-e5be-4a2d-be1c-a5fdd840501b service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:49.955085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-6c69690e-8e8e-47e4-93a1-29b5f243e056 req-d602bac0-e5be-4a2d-be1c-a5fdd840501b service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:49.966804 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-6c69690e-8e8e-47e4-93a1-29b5f243e056 req-d602bac0-e5be-4a2d-be1c-a5fdd840501b service nova] Creating event network-changed:1570e8e0-72d4-4af1-9343-59fc9f178c6f for instance 0e5de64b-6114-45a7-8460-9c4379efd920 on hv-cinder-79987 Jul 14 14:38:49.972194 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-6c69690e-8e8e-47e4-93a1-29b5f243e056 req-d602bac0-e5be-4a2d-be1c-a5fdd840501b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031107 Jul 14 14:38:49.974075 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 396/800] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:00.666912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=13 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:00.667678 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=36 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:00.671663 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a452523e-43a5-441c-88a8-6b6cfe50d2e7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:00.682712 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a452523e-43a5-441c-88a8-6b6cfe50d2e7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:00.682712 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a452523e-43a5-441c-88a8-6b6cfe50d2e7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:00.682712 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a452523e-43a5-441c-88a8-6b6cfe50d2e7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:00.682712 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a452523e-43a5-441c-88a8-6b6cfe50d2e7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:00.683163 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a452523e-43a5-441c-88a8-6b6cfe50d2e7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:00.708625 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a452523e-43a5-441c-88a8-6b6cfe50d2e7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/os-volume_attachments/ae96d159-824d-4f4f-832c-1390e5af3707" status: 200 len: 194 microversion: 2.20 time: 0.043100 Jul 14 14:39:00.709199 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 405/801] 10.222.0.93 () {60 vars in 1453 bytes} [Thu Jul 14 14:39:00 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/os-volume_attachments/ae96d159-824d-4f4f-832c-1390e5af3707 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:39:00.770466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:00.771210 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=7 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:00.775369 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c2ef4313-1cf9-4a64-89f9-665d45445d03 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:00.775958 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c2ef4313-1cf9-4a64-89f9-665d45445d03 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:00.782813 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c2ef4313-1cf9-4a64-89f9-665d45445d03 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:00.787620 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c2ef4313-1cf9-4a64-89f9-665d45445d03 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:00.787620 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c2ef4313-1cf9-4a64-89f9-665d45445d03 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:00.787620 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c2ef4313-1cf9-4a64-89f9-665d45445d03 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:00.869431 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-c2ef4313-1cf9-4a64-89f9-665d45445d03 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lazy-loading 'services' on Instance uuid 9d810a21-86d3-4d18-b9d6-eae39990ac26 {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:01.179323 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c2ef4313-1cf9-4a64-89f9-665d45445d03 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/os-volume_attachments/ae96d159-824d-4f4f-832c-1390e5af3707" status: 202 len: 0 microversion: 2.20 time: 0.410366 Jul 14 14:39:01.179908 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 397/802] 10.222.0.93 () {60 vars in 1456 bytes} [Thu Jul 14 14:39:00 2022] DELETE /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/os-volume_attachments/ae96d159-824d-4f4f-832c-1390e5af3707 => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:39:01.189484 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-563879e1-6781-4d84-862f-bc02c4b76ded tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:01.190529 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-563879e1-6781-4d84-862f-bc02c4b76ded tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:01.196762 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-563879e1-6781-4d84-862f-bc02c4b76ded tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:01.197201 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-563879e1-6781-4d84-862f-bc02c4b76ded tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:01.197974 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-563879e1-6781-4d84-862f-bc02c4b76ded tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:01.198399 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-563879e1-6781-4d84-862f-bc02c4b76ded tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:01.227170 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-563879e1-6781-4d84-862f-bc02c4b76ded tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042369 Jul 14 14:39:01.227849 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 406/803] 10.222.0.93 () {60 vars in 1342 bytes} [Thu Jul 14 14:39:01 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:39:02.240551 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0cdb8ac2-9d10-4c29-8a5f-eb5572402975 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:02.241558 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0cdb8ac2-9d10-4c29-8a5f-eb5572402975 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:02.248346 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0cdb8ac2-9d10-4c29-8a5f-eb5572402975 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:02.248792 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0cdb8ac2-9d10-4c29-8a5f-eb5572402975 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:02.249549 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0cdb8ac2-9d10-4c29-8a5f-eb5572402975 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:02.250014 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0cdb8ac2-9d10-4c29-8a5f-eb5572402975 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:02.280633 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0cdb8ac2-9d10-4c29-8a5f-eb5572402975 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044478 Jul 14 14:39:02.285069 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 398/804] 10.222.0.93 () {60 vars in 1342 bytes} [Thu Jul 14 14:39:02 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:39:03.291636 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-93be3ba3-2c74-4eb5-9f2b-baa224e7374c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:03.292549 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-93be3ba3-2c74-4eb5-9f2b-baa224e7374c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:03.299285 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-93be3ba3-2c74-4eb5-9f2b-baa224e7374c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:03.299728 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-93be3ba3-2c74-4eb5-9f2b-baa224e7374c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.300485 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-93be3ba3-2c74-4eb5-9f2b-baa224e7374c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:03.300942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-93be3ba3-2c74-4eb5-9f2b-baa224e7374c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.330409 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-93be3ba3-2c74-4eb5-9f2b-baa224e7374c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042732 Jul 14 14:39:03.330873 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 407/805] 10.222.0.93 () {60 vars in 1342 bytes} [Thu Jul 14 14:39:03 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:03.388365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-cb7447a6-95fb-4b2d-a0ab-33f39b461ca7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:03.388853 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-cb7447a6-95fb-4b2d-a0ab-33f39b461ca7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:03.395204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cb7447a6-95fb-4b2d-a0ab-33f39b461ca7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:03.395650 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cb7447a6-95fb-4b2d-a0ab-33f39b461ca7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.396389 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cb7447a6-95fb-4b2d-a0ab-33f39b461ca7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:03.396812 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cb7447a6-95fb-4b2d-a0ab-33f39b461ca7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.421782 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-cb7447a6-95fb-4b2d-a0ab-33f39b461ca7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Going to try to terminate instance {{(pid=118462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:39:03.842621 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-cb7447a6-95fb-4b2d-a0ab-33f39b461ca7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 204 len: 0 microversion: 2.20 time: 0.458436 Jul 14 14:39:03.843268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 399/806] 10.222.0.93 () {60 vars in 1279 bytes} [Thu Jul 14 14:39:03 2022] DELETE /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:39:03.851717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4ac5c9c4-63aa-4986-8132-48295f08ea32 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:03.852312 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-4ac5c9c4-63aa-4986-8132-48295f08ea32 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:03.859271 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4ac5c9c4-63aa-4986-8132-48295f08ea32 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:03.859740 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4ac5c9c4-63aa-4986-8132-48295f08ea32 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.860503 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4ac5c9c4-63aa-4986-8132-48295f08ea32 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:03.861039 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4ac5c9c4-63aa-4986-8132-48295f08ea32 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.991937 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4ac5c9c4-63aa-4986-8132-48295f08ea32 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:04.000472 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4ac5c9c4-63aa-4986-8132-48295f08ea32 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:04.002024 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4ac5c9c4-63aa-4986-8132-48295f08ea32 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:04.003299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4ac5c9c4-63aa-4986-8132-48295f08ea32 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1725 microversion: 2.20 time: 0.155591 Jul 14 14:39:04.003782 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 408/807] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:03 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:05.023336 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-80bf176e-b2bc-4af2-9300-7f187011a261 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:05.024021 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-80bf176e-b2bc-4af2-9300-7f187011a261 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:05.031043 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-80bf176e-b2bc-4af2-9300-7f187011a261 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:05.031486 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-80bf176e-b2bc-4af2-9300-7f187011a261 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:05.032245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-80bf176e-b2bc-4af2-9300-7f187011a261 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:05.032707 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-80bf176e-b2bc-4af2-9300-7f187011a261 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:05.162834 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-80bf176e-b2bc-4af2-9300-7f187011a261 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:05.170784 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-80bf176e-b2bc-4af2-9300-7f187011a261 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:05.172314 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-80bf176e-b2bc-4af2-9300-7f187011a261 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:05.173456 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-80bf176e-b2bc-4af2-9300-7f187011a261 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1725 microversion: 2.20 time: 0.154422 Jul 14 14:39:05.174200 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 400/808] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:05 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:06.192153 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-008fd539-96f6-49a0-82e5-543577fe5a09 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:06.192774 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-008fd539-96f6-49a0-82e5-543577fe5a09 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:06.199591 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-008fd539-96f6-49a0-82e5-543577fe5a09 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:06.200880 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-008fd539-96f6-49a0-82e5-543577fe5a09 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:06.200880 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-008fd539-96f6-49a0-82e5-543577fe5a09 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:06.201194 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-008fd539-96f6-49a0-82e5-543577fe5a09 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:06.266778 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-008fd539-96f6-49a0-82e5-543577fe5a09 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:06.275396 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-008fd539-96f6-49a0-82e5-543577fe5a09 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:06.277225 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-008fd539-96f6-49a0-82e5-543577fe5a09 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:06.278429 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-008fd539-96f6-49a0-82e5-543577fe5a09 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1658 microversion: 2.20 time: 0.090289 Jul 14 14:39:06.278991 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 409/809] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:06 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1658 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:06.626159 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-290ddae9-333a-4f7d-8283-d46d632097ba req-f128eca1-6c90-48e5-b808-570a8ba62b85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d810a21-86d3-4d18-b9d6-eae39990ac26", "name": "network-vif-deleted", "tag": "56e9cb11-f5b0-4131-82d8-c97417b17d2c"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:06.636376 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-290ddae9-333a-4f7d-8283-d46d632097ba req-f128eca1-6c90-48e5-b808-570a8ba62b85 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:06.636812 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-290ddae9-333a-4f7d-8283-d46d632097ba req-f128eca1-6c90-48e5-b808-570a8ba62b85 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:06.647928 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-290ddae9-333a-4f7d-8283-d46d632097ba req-f128eca1-6c90-48e5-b808-570a8ba62b85 service nova] Creating event network-vif-deleted:56e9cb11-f5b0-4131-82d8-c97417b17d2c for instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 on hv-cinder-79987 Jul 14 14:39:06.654029 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-290ddae9-333a-4f7d-8283-d46d632097ba req-f128eca1-6c90-48e5-b808-570a8ba62b85 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031511 Jul 14 14:39:06.654658 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 401/810] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:07.296863 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-2f8e735f-cab1-4e2d-bbba-bc62db4d413c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:07.297463 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-2f8e735f-cab1-4e2d-bbba-bc62db4d413c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:07.304364 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2f8e735f-cab1-4e2d-bbba-bc62db4d413c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:07.308413 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2f8e735f-cab1-4e2d-bbba-bc62db4d413c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:07.308413 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2f8e735f-cab1-4e2d-bbba-bc62db4d413c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:07.308413 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2f8e735f-cab1-4e2d-bbba-bc62db4d413c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:07.340282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2f8e735f-cab1-4e2d-bbba-bc62db4d413c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:07.340282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2f8e735f-cab1-4e2d-bbba-bc62db4d413c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:07.340282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.objects.instance [None req-2f8e735f-cab1-4e2d-bbba-bc62db4d413c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lazy-loading 'fault' on Instance uuid 9d810a21-86d3-4d18-b9d6-eae39990ac26 {{(pid=118461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:07.381059 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-2f8e735f-cab1-4e2d-bbba-bc62db4d413c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:07.389557 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-2f8e735f-cab1-4e2d-bbba-bc62db4d413c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:07.391136 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-2f8e735f-cab1-4e2d-bbba-bc62db4d413c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:07.392293 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-2f8e735f-cab1-4e2d-bbba-bc62db4d413c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 200 len: 1372 microversion: 2.20 time: 0.099341 Jul 14 14:39:07.392847 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 410/811] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:07 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:08.412127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f6b82f8a-4b6a-4fd5-90d7-dff4b7770803 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:08.412836 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f6b82f8a-4b6a-4fd5-90d7-dff4b7770803 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:08.419673 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f6b82f8a-4b6a-4fd5-90d7-dff4b7770803 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:08.420111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f6b82f8a-4b6a-4fd5-90d7-dff4b7770803 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:08.420857 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f6b82f8a-4b6a-4fd5-90d7-dff4b7770803 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:08.421282 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f6b82f8a-4b6a-4fd5-90d7-dff4b7770803 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:08.434044 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-f6b82f8a-4b6a-4fd5-90d7-dff4b7770803 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] HTTP exception thrown: Instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 could not be found. Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f6b82f8a-4b6a-4fd5-90d7-dff4b7770803 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Request method failure captured: Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 HTTP/1.1 Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0CnoYQbKwq8kU_5wNcosEgjOYNzujHJ85UInUmEl35vtd8o6ruzgGoSGgdKatIygkH6MtNbeI4n75875r1mVgJuc4qNgBbBxb1W_52tgpHaKGyIIXOSKCrGhE6XpTSHmT0fLG9WvbjpAR9Z20B_eJdUFeRnUwWDVjYXkaVsL5oClC7Y Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: 7378149db04942bdbc1035f0a3a902fe Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-377922018 Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:39:08.435767 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:39:08.437253 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:39:08.437253 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-AttachVolumeShelveTestJSON-377922018 Jul 14 14:39:08.437253 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: 7378149db04942bdbc1035f0a3a902fe Jul 14 14:39:08.437253 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-377922018 Jul 14 14:39:08.437253 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-AttachVolumeShelveTestJSON-377922018-project Jul 14 14:39:08.437253 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:39:08.437253 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:39:08.437253 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 01c0469b67814077b4544cea54a0192e Jul 14 14:39:08.437253 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-AttachVolumeShelveTestJSON-377922018-project Jul 14 14:39:08.437253 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:39:08.437253 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 could not be found. Jul 14 14:39:08.437253 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '9d810a21-86d3-4d18-b9d6-eae39990ac26'} Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 could not be found. Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:08.438204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:08.439765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:08.439765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:39:08.439765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:39:08.439765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:39:08.439765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:39:08.439765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:39:08.439765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:39:08.439765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 could not be found. Jul 14 14:39:08.439765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:08.439765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:08.439765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:08.439765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:08.439765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:08.439765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:08.439765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:08.439765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:08.439765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 could not be found. Jul 14 14:39:08.439765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:08.441092 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f6b82f8a-4b6a-4fd5-90d7-dff4b7770803 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Returning 404 to user: Instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:08.441092 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f6b82f8a-4b6a-4fd5-90d7-dff4b7770803 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 404 len: 111 microversion: 2.20 time: 0.029833 Jul 14 14:39:08.441092 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 402/812] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:08 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:39:08.446185 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-3926b4e4-fce8-44dd-96a2-b58e3ea732f1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '.version_select at 0x7f415fdace50>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:08.546009 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-3926b4e4-fce8-44dd-96a2-b58e3ea732f1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1270997806" status: 204 len: 0 microversion: 2.20 time: 0.103674 Jul 14 14:39:08.546577 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 411/813] 10.222.0.93 () {60 vars in 1261 bytes} [Thu Jul 14 14:39:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1270997806 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:39:09.341476 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-3d78058f-219e-46f4-81b0-06f9e352c4fc tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Action: 'create', calling method: .version_select at 0x7f416c452820>, body: {"keypair": {"name": "tempest-keypair-418223272", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6Nnk4xdfpLnzMumKwrr8fUpIC1fyHuYAzEwKwrY/lTOrZKzAaOo4smolaiNK9cVLG81ex4VbeqVCwdCXKuYVYSmhqCw7ajHdgF8GVQpBJNW5WoyTFlRxC9bviTSCmZow=="}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:09.355337 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-3d78058f-219e-46f4-81b0-06f9e352c4fc tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Getting quotas for project 7378149db04942bdbc1035f0a3a902fe. Resources: {'key_pairs'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:09.359632 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-3d78058f-219e-46f4-81b0-06f9e352c4fc tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Getting quotas for user 01c0469b67814077b4544cea54a0192e and project 7378149db04942bdbc1035f0a3a902fe. Resources: {'key_pairs'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:09.443801 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-3d78058f-219e-46f4-81b0-06f9e352c4fc tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.106701 Jul 14 14:39:09.444570 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 403/814] 10.222.0.93 () {62 vars in 1199 bytes} [Thu Jul 14 14:39:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:39:11.740219 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f33227b2-4c81-4f91-840d-05e274ad2c33 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1792102713", "imageRef": "7ea875a4-facb-4053-be2d-ff0080d2f3a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44167c18-8a2e-4113-86a9-34428792d360"}], "security_groups": [{"name": "tempest-securitygroup--1450949517"}], "key_name": "tempest-keypair-418223272", "user_data": "}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:11.840826 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.network.neutron [None req-f33227b2-4c81-4f91-840d-05e274ad2c33 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] validate_networks() for [('44167c18-8a2e-4113-86a9-34428792d360', None, None, None, None, None)] {{(pid=118461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:39:12.213222 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-f33227b2-4c81-4f91-840d-05e274ad2c33 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Flavor limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:39:12.213645 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-f33227b2-4c81-4f91-840d-05e274ad2c33 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Image limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:39:12.214176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-f33227b2-4c81-4f91-840d-05e274ad2c33 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Flavor pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:39:12.214584 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-f33227b2-4c81-4f91-840d-05e274ad2c33 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Image pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:39:12.214994 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-f33227b2-4c81-4f91-840d-05e274ad2c33 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:39:12.223928 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f33227b2-4c81-4f91-840d-05e274ad2c33 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:12.224330 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f33227b2-4c81-4f91-840d-05e274ad2c33 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:12.225124 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f33227b2-4c81-4f91-840d-05e274ad2c33 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:12.225553 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f33227b2-4c81-4f91-840d-05e274ad2c33 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:12.241942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-f33227b2-4c81-4f91-840d-05e274ad2c33 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Getting quotas for project 7378149db04942bdbc1035f0a3a902fe. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:12.246368 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-f33227b2-4c81-4f91-840d-05e274ad2c33 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Getting quotas for user 01c0469b67814077b4544cea54a0192e and project 7378149db04942bdbc1035f0a3a902fe. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:12.256908 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-f33227b2-4c81-4f91-840d-05e274ad2c33 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Going to run 1 instances... {{(pid=118461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:39:12.259248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-f33227b2-4c81-4f91-840d-05e274ad2c33 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ea875a4-facb-4053-be2d-ff0080d2f3a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:39:12.485135 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-f33227b2-4c81-4f91-840d-05e274ad2c33 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.749385 Jul 14 14:39:12.485722 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 412/815] 10.222.0.93 () {62 vars in 1187 bytes} [Thu Jul 14 14:39:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:39:12.497093 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-46378290-cbd6-4934-8c05-4eec55d54538 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:12.497804 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-46378290-cbd6-4934-8c05-4eec55d54538 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:12.552055 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-46378290-cbd6-4934-8c05-4eec55d54538 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:12.559938 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-46378290-cbd6-4934-8c05-4eec55d54538 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:12.561467 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-46378290-cbd6-4934-8c05-4eec55d54538 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:12.562588 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-46378290-cbd6-4934-8c05-4eec55d54538 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1281 microversion: 2.20 time: 0.070735 Jul 14 14:39:12.563127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 404/816] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:12 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:13.581229 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-8336664c-25fa-4cf3-a0f6-06e3983ddac1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:13.581905 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-8336664c-25fa-4cf3-a0f6-06e3983ddac1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:13.588162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8336664c-25fa-4cf3-a0f6-06e3983ddac1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:13.589194 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8336664c-25fa-4cf3-a0f6-06e3983ddac1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:13.589995 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8336664c-25fa-4cf3-a0f6-06e3983ddac1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:13.590434 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8336664c-25fa-4cf3-a0f6-06e3983ddac1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:13.655658 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-8336664c-25fa-4cf3-a0f6-06e3983ddac1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:13.664010 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-8336664c-25fa-4cf3-a0f6-06e3983ddac1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:13.665535 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-8336664c-25fa-4cf3-a0f6-06e3983ddac1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:13.667209 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-8336664c-25fa-4cf3-a0f6-06e3983ddac1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1277 microversion: 2.20 time: 0.090070 Jul 14 14:39:13.667766 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 413/817] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:13 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:14.687239 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-12874fec-faf7-4862-af69-c676dacf2aed tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:14.687826 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-12874fec-faf7-4862-af69-c676dacf2aed tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:14.693970 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-12874fec-faf7-4862-af69-c676dacf2aed tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:14.694407 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-12874fec-faf7-4862-af69-c676dacf2aed tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:14.695206 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-12874fec-faf7-4862-af69-c676dacf2aed tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:14.695582 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-12874fec-faf7-4862-af69-c676dacf2aed tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:14.768404 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-12874fec-faf7-4862-af69-c676dacf2aed tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:14.776804 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-12874fec-faf7-4862-af69-c676dacf2aed tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:14.778360 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-12874fec-faf7-4862-af69-c676dacf2aed tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:14.779557 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-12874fec-faf7-4862-af69-c676dacf2aed tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1351 microversion: 2.20 time: 0.097344 Jul 14 14:39:14.780116 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 405/818] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:14 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:15.797913 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-7857f56b-6196-4d7d-be6a-a093dd60e195 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:15.798714 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-7857f56b-6196-4d7d-be6a-a093dd60e195 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:15.805977 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7857f56b-6196-4d7d-be6a-a093dd60e195 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:15.806419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7857f56b-6196-4d7d-be6a-a093dd60e195 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:15.807689 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7857f56b-6196-4d7d-be6a-a093dd60e195 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:15.808117 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7857f56b-6196-4d7d-be6a-a093dd60e195 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:15.947013 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7857f56b-6196-4d7d-be6a-a093dd60e195 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:15.955954 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7857f56b-6196-4d7d-be6a-a093dd60e195 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:15.958446 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7857f56b-6196-4d7d-be6a-a093dd60e195 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:15.959860 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-7857f56b-6196-4d7d-be6a-a093dd60e195 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1407 microversion: 2.20 time: 0.165901 Jul 14 14:39:15.960421 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 414/819] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:15 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:16.232295 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-f96d70a3-ed33-44a0-9811-467448fc6aa3 req-ab0baabc-2aef-4215-898b-01a37600ec0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bad9638-c252-4901-8de1-beeaf6a59bbd", "tag": "ee6ee1a4-93da-4c93-9496-0e46449759f1"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:16.243305 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-f96d70a3-ed33-44a0-9811-467448fc6aa3 req-ab0baabc-2aef-4215-898b-01a37600ec0c service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:16.243305 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-f96d70a3-ed33-44a0-9811-467448fc6aa3 req-ab0baabc-2aef-4215-898b-01a37600ec0c service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:16.256141 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-f96d70a3-ed33-44a0-9811-467448fc6aa3 req-ab0baabc-2aef-4215-898b-01a37600ec0c service nova] Creating event network-changed:ee6ee1a4-93da-4c93-9496-0e46449759f1 for instance 8bad9638-c252-4901-8de1-beeaf6a59bbd on hv-cinder-79987 Jul 14 14:39:16.261259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-f96d70a3-ed33-44a0-9811-467448fc6aa3 req-ab0baabc-2aef-4215-898b-01a37600ec0c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037395 Jul 14 14:39:16.262237 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 406/820] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:17.045756 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e894612b-eb49-4ca4-bb91-f61357a9a2ab tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:17.046701 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e894612b-eb49-4ca4-bb91-f61357a9a2ab tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:17.058092 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e894612b-eb49-4ca4-bb91-f61357a9a2ab tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:17.060420 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e894612b-eb49-4ca4-bb91-f61357a9a2ab tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:17.060420 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e894612b-eb49-4ca4-bb91-f61357a9a2ab tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:17.061107 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e894612b-eb49-4ca4-bb91-f61357a9a2ab tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:17.198818 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e894612b-eb49-4ca4-bb91-f61357a9a2ab tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:17.206913 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e894612b-eb49-4ca4-bb91-f61357a9a2ab tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:17.208355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e894612b-eb49-4ca4-bb91-f61357a9a2ab tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:17.209439 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e894612b-eb49-4ca4-bb91-f61357a9a2ab tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1407 microversion: 2.20 time: 0.169277 Jul 14 14:39:17.210024 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 415/821] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:17 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:18.228874 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-39e9ed58-cfc2-4a82-83a6-aa441f9b8111 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:18.229541 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-39e9ed58-cfc2-4a82-83a6-aa441f9b8111 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:18.235771 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-39e9ed58-cfc2-4a82-83a6-aa441f9b8111 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:18.236214 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-39e9ed58-cfc2-4a82-83a6-aa441f9b8111 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:18.236970 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-39e9ed58-cfc2-4a82-83a6-aa441f9b8111 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:18.237402 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-39e9ed58-cfc2-4a82-83a6-aa441f9b8111 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:18.371065 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-39e9ed58-cfc2-4a82-83a6-aa441f9b8111 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:18.378993 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-39e9ed58-cfc2-4a82-83a6-aa441f9b8111 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:18.380575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-39e9ed58-cfc2-4a82-83a6-aa441f9b8111 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:18.381669 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-39e9ed58-cfc2-4a82-83a6-aa441f9b8111 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1407 microversion: 2.20 time: 0.157821 Jul 14 14:39:18.382257 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 407/822] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:18 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:19.404272 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-7e7feed2-5be9-440d-8644-c1b3a3ee1f88 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:19.404272 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-7e7feed2-5be9-440d-8644-c1b3a3ee1f88 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:19.408052 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7e7feed2-5be9-440d-8644-c1b3a3ee1f88 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:19.408495 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7e7feed2-5be9-440d-8644-c1b3a3ee1f88 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:19.409282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7e7feed2-5be9-440d-8644-c1b3a3ee1f88 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:19.409709 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7e7feed2-5be9-440d-8644-c1b3a3ee1f88 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:19.537672 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7e7feed2-5be9-440d-8644-c1b3a3ee1f88 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:19.546193 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7e7feed2-5be9-440d-8644-c1b3a3ee1f88 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:19.547729 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7e7feed2-5be9-440d-8644-c1b3a3ee1f88 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:19.548827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-7e7feed2-5be9-440d-8644-c1b3a3ee1f88 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1407 microversion: 2.20 time: 0.152631 Jul 14 14:39:19.549376 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 416/823] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:19 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:20.567223 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-75cfcab9-bae5-4be6-be04-1cb02582c309 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:20.567809 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-75cfcab9-bae5-4be6-be04-1cb02582c309 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:20.574432 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-75cfcab9-bae5-4be6-be04-1cb02582c309 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:20.574869 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-75cfcab9-bae5-4be6-be04-1cb02582c309 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:20.575613 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-75cfcab9-bae5-4be6-be04-1cb02582c309 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:20.576035 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-75cfcab9-bae5-4be6-be04-1cb02582c309 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:20.707126 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-75cfcab9-bae5-4be6-be04-1cb02582c309 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:20.715576 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-75cfcab9-bae5-4be6-be04-1cb02582c309 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:20.717062 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-75cfcab9-bae5-4be6-be04-1cb02582c309 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:20.718170 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-75cfcab9-bae5-4be6-be04-1cb02582c309 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1407 microversion: 2.20 time: 0.154826 Jul 14 14:39:20.718720 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 408/824] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:20 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:21.735424 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-90f03659-c25f-4eeb-9215-20cce4b08948 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:21.736023 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-90f03659-c25f-4eeb-9215-20cce4b08948 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:21.742500 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-90f03659-c25f-4eeb-9215-20cce4b08948 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:21.743301 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-90f03659-c25f-4eeb-9215-20cce4b08948 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:21.743694 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-90f03659-c25f-4eeb-9215-20cce4b08948 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:21.744680 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-90f03659-c25f-4eeb-9215-20cce4b08948 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:21.873563 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-d3d6fa69-08c7-4a0d-a69c-7f9b7996830e req-fa85d6a3-f435-4d97-a61d-7b78cc043fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bad9638-c252-4901-8de1-beeaf6a59bbd", "name": "network-vif-plugged", "status": "completed", "tag": "ee6ee1a4-93da-4c93-9496-0e46449759f1"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:21.876178 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-90f03659-c25f-4eeb-9215-20cce4b08948 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:21.882868 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-d3d6fa69-08c7-4a0d-a69c-7f9b7996830e req-fa85d6a3-f435-4d97-a61d-7b78cc043fac service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:21.883574 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-d3d6fa69-08c7-4a0d-a69c-7f9b7996830e req-fa85d6a3-f435-4d97-a61d-7b78cc043fac service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:21.884064 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-90f03659-c25f-4eeb-9215-20cce4b08948 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:21.885612 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-90f03659-c25f-4eeb-9215-20cce4b08948 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:21.886763 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-90f03659-c25f-4eeb-9215-20cce4b08948 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1407 microversion: 2.20 time: 0.155221 Jul 14 14:39:21.887315 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 417/825] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:21 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:21.894586 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-d3d6fa69-08c7-4a0d-a69c-7f9b7996830e req-fa85d6a3-f435-4d97-a61d-7b78cc043fac service nova] Creating event network-vif-plugged:ee6ee1a4-93da-4c93-9496-0e46449759f1 for instance 8bad9638-c252-4901-8de1-beeaf6a59bbd on hv-cinder-79987 Jul 14 14:39:21.899391 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-d3d6fa69-08c7-4a0d-a69c-7f9b7996830e req-fa85d6a3-f435-4d97-a61d-7b78cc043fac service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030768 Jul 14 14:39:21.900157 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 409/826] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:39:22.904832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4088c518-32b4-4503-858f-2bbb4ef3f011 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:22.905395 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-4088c518-32b4-4503-858f-2bbb4ef3f011 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:22.907293 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:22.908031 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=6 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:22.913234 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4088c518-32b4-4503-858f-2bbb4ef3f011 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:22.918094 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4088c518-32b4-4503-858f-2bbb4ef3f011 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:22.918094 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4088c518-32b4-4503-858f-2bbb4ef3f011 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:22.918094 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4088c518-32b4-4503-858f-2bbb4ef3f011 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:23.047835 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4088c518-32b4-4503-858f-2bbb4ef3f011 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:23.056085 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4088c518-32b4-4503-858f-2bbb4ef3f011 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:23.058249 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4088c518-32b4-4503-858f-2bbb4ef3f011 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:23.061076 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4088c518-32b4-4503-858f-2bbb4ef3f011 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1407 microversion: 2.20 time: 0.159178 Jul 14 14:39:23.061076 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 418/827] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:22 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:24.076581 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=6 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:24.081251 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a87683c1-0b20-408e-8d3f-63a571006e84 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:24.081964 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a87683c1-0b20-408e-8d3f-63a571006e84 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:24.088148 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a87683c1-0b20-408e-8d3f-63a571006e84 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:24.088583 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a87683c1-0b20-408e-8d3f-63a571006e84 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:24.089332 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a87683c1-0b20-408e-8d3f-63a571006e84 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:24.089760 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a87683c1-0b20-408e-8d3f-63a571006e84 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:24.229410 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a87683c1-0b20-408e-8d3f-63a571006e84 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:24.230444 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a87683c1-0b20-408e-8d3f-63a571006e84 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:24.231951 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a87683c1-0b20-408e-8d3f-63a571006e84 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:24.233047 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a87683c1-0b20-408e-8d3f-63a571006e84 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1407 microversion: 2.20 time: 0.157477 Jul 14 14:39:24.233715 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 410/828] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:24 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:25.251100 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-7dca89d4-a92a-4f61-a7fc-d2a4ffcbc6e7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:25.251689 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-7dca89d4-a92a-4f61-a7fc-d2a4ffcbc6e7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:25.258574 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7dca89d4-a92a-4f61-a7fc-d2a4ffcbc6e7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:25.259020 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7dca89d4-a92a-4f61-a7fc-d2a4ffcbc6e7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:25.259790 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7dca89d4-a92a-4f61-a7fc-d2a4ffcbc6e7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:25.260223 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7dca89d4-a92a-4f61-a7fc-d2a4ffcbc6e7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:25.391249 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7dca89d4-a92a-4f61-a7fc-d2a4ffcbc6e7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:25.399393 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7dca89d4-a92a-4f61-a7fc-d2a4ffcbc6e7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:25.401519 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7dca89d4-a92a-4f61-a7fc-d2a4ffcbc6e7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:25.402695 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-7dca89d4-a92a-4f61-a7fc-d2a4ffcbc6e7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1599 microversion: 2.20 time: 0.155528 Jul 14 14:39:25.403262 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 419/829] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:25 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:25.420728 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-1d46d84d-2c02-4697-ab55-8a58285bacb7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:25.421311 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-1d46d84d-2c02-4697-ab55-8a58285bacb7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:25.427329 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1d46d84d-2c02-4697-ab55-8a58285bacb7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:25.427830 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1d46d84d-2c02-4697-ab55-8a58285bacb7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:25.428582 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1d46d84d-2c02-4697-ab55-8a58285bacb7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:25.429010 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1d46d84d-2c02-4697-ab55-8a58285bacb7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:25.508166 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-1d46d84d-2c02-4697-ab55-8a58285bacb7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091975 Jul 14 14:39:25.508758 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 411/830] 10.222.0.93 () {60 vars in 1315 bytes} [Thu Jul 14 14:39:25 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:39:25.841017 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ba2515ae-0ae0-4fee-bcd9-00ac08104c2c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:25.841407 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-ba2515ae-0ae0-4fee-bcd9-00ac08104c2c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:25.847531 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ba2515ae-0ae0-4fee-bcd9-00ac08104c2c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:25.847980 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ba2515ae-0ae0-4fee-bcd9-00ac08104c2c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:25.848730 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ba2515ae-0ae0-4fee-bcd9-00ac08104c2c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:25.849156 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ba2515ae-0ae0-4fee-bcd9-00ac08104c2c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:25.872782 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-ba2515ae-0ae0-4fee-bcd9-00ac08104c2c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920/ips" status: 200 len: 149 microversion: 2.1 time: 0.035819 Jul 14 14:39:25.873383 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 420/831] 10.222.0.93 () {58 vars in 1247 bytes} [Thu Jul 14 14:39:25 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:39:25.883967 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f393b62c-b841-4ad2-9976-962ed316f032 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcadb717-ef62-4a55-a8b8-77b89a65c772"}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:25.885634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f393b62c-b841-4ad2-9976-962ed316f032 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:25.891667 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f393b62c-b841-4ad2-9976-962ed316f032 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:25.892117 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f393b62c-b841-4ad2-9976-962ed316f032 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:25.892883 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f393b62c-b841-4ad2-9976-962ed316f032 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:25.893318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f393b62c-b841-4ad2-9976-962ed316f032 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:25.977253 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-f393b62c-b841-4ad2-9976-962ed316f032 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] HTTP exception thrown: Invalid volume: volume bcadb717-ef62-4a55-a8b8-77b89a65c772 is already attached to instances: 36276a10-ba93-4cae-abe5-f5484419f580 Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f393b62c-b841-4ad2-9976-962ed316f032 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Request method failure captured: Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: POST /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920/os-volume_attachments HTTP/1.1 Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 74 Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0Coo2gQogloRyym-Nd5AKwohPbpaRVZzos2SNok6dsmiCUJQmaykmjw3JyCJGMIH4FxV3wh3mUDSl5SZMVXqBFX7Lk4CWppNzlNQJtOMoX0ubLPJKvnCDDOBuNYnggBOJcheNqaeVxGGln05C89djgP50UkOcd_oy4_GhZ5i307EiWw Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:39:25.979514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:39:25.981223 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:39:25.981223 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:39:25.981223 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:39:25.981223 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:39:25.981223 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:39:25.981223 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:39:25.981223 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:39:25.981223 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 98f00ffeef484dd489ed67b96d1ed783 Jul 14 14:39:25.981223 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:39:25.981223 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Jul 14 14:39:25.981223 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {"volumeAttachment": {"volumeId": "bcadb717-ef62-4a55-a8b8-77b89a65c772"}} Jul 14 14:39:25.981223 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:39:25.982304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Invalid volume: volume bcadb717-ef62-4a55-a8b8-77b89a65c772 is already attached to instances: 36276a10-ba93-4cae-abe5-f5484419f580 Jul 14 14:39:25.982304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'server_id': '0e5de64b-6114-45a7-8460-9c4379efd920', 'body': {'volumeAttachment': {'volumeId': 'bcadb717-ef62-4a55-a8b8-77b89a65c772'}}} Jul 14 14:39:25.982304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:25.982304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:25.982304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 14:39:25.982304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 14:39:25.982304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:39:25.982304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:39:25.982304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 14:39:25.982304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:39:25.982304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 14:39:25.982304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 14:39:25.982304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 14:39:25.982304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 14:39:25.982304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bcadb717-ef62-4a55-a8b8-77b89a65c772 is already attached to instances: 36276a10-ba93-4cae-abe5-f5484419f580 Jul 14 14:39:25.982304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:25.982304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:25.982304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:25.982304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bcadb717-ef62-4a55-a8b8-77b89a65c772 is already attached to instances: 36276a10-ba93-4cae-abe5-f5484419f580 Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:25.983858 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:25.985457 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:25.985457 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:25.985457 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:25.985457 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bcadb717-ef62-4a55-a8b8-77b89a65c772 is already attached to instances: 36276a10-ba93-4cae-abe5-f5484419f580 Jul 14 14:39:25.985457 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:25.985457 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f393b62c-b841-4ad2-9976-962ed316f032 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Returning 400 to user: Invalid volume: volume bcadb717-ef62-4a55-a8b8-77b89a65c772 is already attached to instances: 36276a10-ba93-4cae-abe5-f5484419f580 {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:25.985457 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f393b62c-b841-4ad2-9976-962ed316f032 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "POST /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101096 Jul 14 14:39:25.985457 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 412/832] 10.222.0.93 () {60 vars in 1322 bytes} [Thu Jul 14 14:39:25 2022] POST /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:39:25.991199 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-cd898de9-4ded-4987-b318-ed8d9dc3e31f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:25.991705 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-cd898de9-4ded-4987-b318-ed8d9dc3e31f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:25.999022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cd898de9-4ded-4987-b318-ed8d9dc3e31f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:25.999458 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cd898de9-4ded-4987-b318-ed8d9dc3e31f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:26.000204 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cd898de9-4ded-4987-b318-ed8d9dc3e31f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:26.000625 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cd898de9-4ded-4987-b318-ed8d9dc3e31f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:26.025361 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-cd898de9-4ded-4987-b318-ed8d9dc3e31f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Going to try to terminate instance {{(pid=118461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:39:26.128896 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:26.310106 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-cd898de9-4ded-4987-b318-ed8d9dc3e31f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 204 len: 0 microversion: 2.1 time: 0.322421 Jul 14 14:39:26.310977 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 421/833] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:39:25 2022] DELETE /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:39:26.319341 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0ccd970c-b5f7-406b-bb45-9b395a514fd6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:26.320597 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0ccd970c-b5f7-406b-bb45-9b395a514fd6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:26.328487 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ccd970c-b5f7-406b-bb45-9b395a514fd6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:26.334213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ccd970c-b5f7-406b-bb45-9b395a514fd6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:26.334213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ccd970c-b5f7-406b-bb45-9b395a514fd6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:26.334213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ccd970c-b5f7-406b-bb45-9b395a514fd6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:26.561341 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-0ccd970c-b5f7-406b-bb45-9b395a514fd6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:26.570917 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0ccd970c-b5f7-406b-bb45-9b395a514fd6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 200 len: 1680 microversion: 2.1 time: 0.255649 Jul 14 14:39:26.571513 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 413/834] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:26 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 1680 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:26.577859 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-c9038193-fc35-4cfa-ae62-93a87397564a req-97d8fbf3-6d14-44d7-bf4e-4ad211f61f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bad9638-c252-4901-8de1-beeaf6a59bbd", "tag": "ee6ee1a4-93da-4c93-9496-0e46449759f1"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:26.583623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-c9038193-fc35-4cfa-ae62-93a87397564a req-97d8fbf3-6d14-44d7-bf4e-4ad211f61f38 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:26.584063 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-c9038193-fc35-4cfa-ae62-93a87397564a req-97d8fbf3-6d14-44d7-bf4e-4ad211f61f38 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:26.595625 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-c9038193-fc35-4cfa-ae62-93a87397564a req-97d8fbf3-6d14-44d7-bf4e-4ad211f61f38 service nova] Creating event network-changed:ee6ee1a4-93da-4c93-9496-0e46449759f1 for instance 8bad9638-c252-4901-8de1-beeaf6a59bbd on hv-cinder-79987 Jul 14 14:39:26.600588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-c9038193-fc35-4cfa-ae62-93a87397564a req-97d8fbf3-6d14-44d7-bf4e-4ad211f61f38 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028922 Jul 14 14:39:26.601177 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 422/835] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:27.588548 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-61261599-2fba-462d-a894-daf4d550cedc tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:27.589271 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-61261599-2fba-462d-a894-daf4d550cedc tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:27.597058 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-61261599-2fba-462d-a894-daf4d550cedc tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:27.597668 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-61261599-2fba-462d-a894-daf4d550cedc tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:27.598923 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-61261599-2fba-462d-a894-daf4d550cedc tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:27.599422 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-61261599-2fba-462d-a894-daf4d550cedc tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:27.740157 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-61261599-2fba-462d-a894-daf4d550cedc tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:27.749353 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-61261599-2fba-462d-a894-daf4d550cedc tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 200 len: 1680 microversion: 2.1 time: 0.164687 Jul 14 14:39:27.754853 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 414/836] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:27 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:28.767603 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-82f7a56f-0537-4561-a4b0-1b86a8117265 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:28.768300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-82f7a56f-0537-4561-a4b0-1b86a8117265 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:28.775023 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-82f7a56f-0537-4561-a4b0-1b86a8117265 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:28.775488 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-82f7a56f-0537-4561-a4b0-1b86a8117265 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:28.776244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-82f7a56f-0537-4561-a4b0-1b86a8117265 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:28.776667 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-82f7a56f-0537-4561-a4b0-1b86a8117265 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:28.843232 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-82f7a56f-0537-4561-a4b0-1b86a8117265 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:28.851324 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-82f7a56f-0537-4561-a4b0-1b86a8117265 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 200 len: 1612 microversion: 2.1 time: 0.088420 Jul 14 14:39:28.851897 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 423/837] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:28 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 1612 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:28.992326 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-6eb1eebd-9649-4a33-9ae0-22934b2fc294 req-e7ea29ac-9442-4544-ae2b-b1c1339b2476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5de64b-6114-45a7-8460-9c4379efd920", "name": "network-vif-deleted", "tag": "1570e8e0-72d4-4af1-9343-59fc9f178c6f"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:29.002433 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-6eb1eebd-9649-4a33-9ae0-22934b2fc294 req-e7ea29ac-9442-4544-ae2b-b1c1339b2476 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:29.019451 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-6eb1eebd-9649-4a33-9ae0-22934b2fc294 req-e7ea29ac-9442-4544-ae2b-b1c1339b2476 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:29.019451 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-6eb1eebd-9649-4a33-9ae0-22934b2fc294 req-e7ea29ac-9442-4544-ae2b-b1c1339b2476 service nova] Creating event network-vif-deleted:1570e8e0-72d4-4af1-9343-59fc9f178c6f for instance 0e5de64b-6114-45a7-8460-9c4379efd920 on hv-cinder-79987 Jul 14 14:39:29.019866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-6eb1eebd-9649-4a33-9ae0-22934b2fc294 req-e7ea29ac-9442-4544-ae2b-b1c1339b2476 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030900 Jul 14 14:39:29.020474 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 415/838] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:29.869385 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-441f0e61-caa5-43d5-8d5c-e0ffc9ec003a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:29.870475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-441f0e61-caa5-43d5-8d5c-e0ffc9ec003a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:29.878635 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-441f0e61-caa5-43d5-8d5c-e0ffc9ec003a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:29.879436 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-441f0e61-caa5-43d5-8d5c-e0ffc9ec003a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:29.880385 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-441f0e61-caa5-43d5-8d5c-e0ffc9ec003a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:29.880910 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-441f0e61-caa5-43d5-8d5c-e0ffc9ec003a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:29.913975 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-441f0e61-caa5-43d5-8d5c-e0ffc9ec003a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:29.914517 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-441f0e61-caa5-43d5-8d5c-e0ffc9ec003a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:29.915033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.objects.instance [None req-441f0e61-caa5-43d5-8d5c-e0ffc9ec003a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lazy-loading 'fault' on Instance uuid 0e5de64b-6114-45a7-8460-9c4379efd920 {{(pid=118461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:29.960846 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-441f0e61-caa5-43d5-8d5c-e0ffc9ec003a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:29.969413 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-441f0e61-caa5-43d5-8d5c-e0ffc9ec003a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 200 len: 1330 microversion: 2.1 time: 0.104445 Jul 14 14:39:29.970578 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 424/839] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:29 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:39:30.990688 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7513e2c9-c314-4f0a-9069-1fa44e0363be tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:30.991383 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-7513e2c9-c314-4f0a-9069-1fa44e0363be tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:30.998679 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7513e2c9-c314-4f0a-9069-1fa44e0363be tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:30.999126 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7513e2c9-c314-4f0a-9069-1fa44e0363be tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:30.999877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7513e2c9-c314-4f0a-9069-1fa44e0363be tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:31.000304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7513e2c9-c314-4f0a-9069-1fa44e0363be tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:31.003000 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:31.014949 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-7513e2c9-c314-4f0a-9069-1fa44e0363be tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] HTTP exception thrown: Instance 0e5de64b-6114-45a7-8460-9c4379efd920 could not be found. Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7513e2c9-c314-4f0a-9069-1fa44e0363be tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Request method failure captured: Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 HTTP/1.1 Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0Coo2gQogloRyym-Nd5AKwohPbpaRVZzos2SNok6dsmiCUJQmaykmjw3JyCJGMIH4FxV3wh3mUDSl5SZMVXqBFX7Lk4CWppNzlNQJtOMoX0ubLPJKvnCDDOBuNYnggBOJcheNqaeVxGGln05C89djgP50UkOcd_oy4_GhZ5i307EiWw Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:39:31.016554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:39:31.018170 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:39:31.018170 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:39:31.018170 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:39:31.018170 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:39:31.018170 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:39:31.018170 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:39:31.018170 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:39:31.018170 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 98f00ffeef484dd489ed67b96d1ed783 Jul 14 14:39:31.018170 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:39:31.018170 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:39:31.018170 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 0e5de64b-6114-45a7-8460-9c4379efd920 could not be found. Jul 14 14:39:31.018170 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '0e5de64b-6114-45a7-8460-9c4379efd920'} Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e5de64b-6114-45a7-8460-9c4379efd920 could not be found. Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:31.019098 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:31.020567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:31.020567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:39:31.020567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:39:31.020567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:39:31.020567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:39:31.020567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:39:31.020567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:39:31.020567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e5de64b-6114-45a7-8460-9c4379efd920 could not be found. Jul 14 14:39:31.020567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:31.020567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:31.020567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:31.020567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:31.020567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:31.020567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:31.020567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:31.020567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:31.020567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e5de64b-6114-45a7-8460-9c4379efd920 could not be found. Jul 14 14:39:31.020567 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:31.022303 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7513e2c9-c314-4f0a-9069-1fa44e0363be tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Returning 404 to user: Instance 0e5de64b-6114-45a7-8460-9c4379efd920 could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:31.022303 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-7513e2c9-c314-4f0a-9069-1fa44e0363be tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 404 len: 111 microversion: 2.1 time: 0.031419 Jul 14 14:39:31.022303 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 416/840] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:30 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:39:31.026780 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-883fb49c-d33c-4d42-8726-13fe26c0f07f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '.version_select at 0x7f415fd21790>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:31.117076 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-883fb49c-d33c-4d42-8726-13fe26c0f07f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-784768117" status: 202 len: 0 microversion: 2.1 time: 0.094012 Jul 14 14:39:31.117729 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 425/841] 10.222.0.93 () {58 vars in 1217 bytes} [Thu Jul 14 14:39:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-784768117 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:39:32.028509 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-9533cf7c-4e7f-41a2-8933-5086a9cdafb9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:32.029015 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-9533cf7c-4e7f-41a2-8933-5086a9cdafb9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:32.031695 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:32.036660 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9533cf7c-4e7f-41a2-8933-5086a9cdafb9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:32.037097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9533cf7c-4e7f-41a2-8933-5086a9cdafb9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:32.037867 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9533cf7c-4e7f-41a2-8933-5086a9cdafb9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:32.038343 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9533cf7c-4e7f-41a2-8933-5086a9cdafb9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:32.121517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-9533cf7c-4e7f-41a2-8933-5086a9cdafb9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lazy-loading 'services' on Instance uuid 36276a10-ba93-4cae-abe5-f5484419f580 {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:32.389550 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-9533cf7c-4e7f-41a2-8933-5086a9cdafb9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "DELETE /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580/os-volume_attachments/bcadb717-ef62-4a55-a8b8-77b89a65c772" status: 202 len: 0 microversion: 2.1 time: 0.364698 Jul 14 14:39:32.390482 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 417/842] 10.222.0.93 () {58 vars in 1415 bytes} [Thu Jul 14 14:39:32 2022] DELETE /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580/os-volume_attachments/bcadb717-ef62-4a55-a8b8-77b89a65c772 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:39:32.399153 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-78f6a6da-afc1-4f96-b30c-bb3576a73863 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:32.400096 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-78f6a6da-afc1-4f96-b30c-bb3576a73863 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:32.402276 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:32.407719 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-78f6a6da-afc1-4f96-b30c-bb3576a73863 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:32.409869 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-78f6a6da-afc1-4f96-b30c-bb3576a73863 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:32.409869 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-78f6a6da-afc1-4f96-b30c-bb3576a73863 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:32.409869 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-78f6a6da-afc1-4f96-b30c-bb3576a73863 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:32.438548 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-78f6a6da-afc1-4f96-b30c-bb3576a73863 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043995 Jul 14 14:39:32.439128 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 426/843] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:39:32 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:33.451153 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ed88acaf-a564-4235-97bc-82f143526894 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:33.452153 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ed88acaf-a564-4235-97bc-82f143526894 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:33.458611 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ed88acaf-a564-4235-97bc-82f143526894 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:33.459153 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ed88acaf-a564-4235-97bc-82f143526894 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:33.459926 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ed88acaf-a564-4235-97bc-82f143526894 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:33.460345 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ed88acaf-a564-4235-97bc-82f143526894 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:33.491137 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ed88acaf-a564-4235-97bc-82f143526894 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044866 Jul 14 14:39:33.491695 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 418/844] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:39:33 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:34.504278 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e74564f3-da51-4353-9634-9124aad2cf3b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:34.505198 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e74564f3-da51-4353-9634-9124aad2cf3b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:34.512478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e74564f3-da51-4353-9634-9124aad2cf3b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:34.512918 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e74564f3-da51-4353-9634-9124aad2cf3b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:34.513673 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e74564f3-da51-4353-9634-9124aad2cf3b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:34.514139 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e74564f3-da51-4353-9634-9124aad2cf3b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:34.543380 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e74564f3-da51-4353-9634-9124aad2cf3b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043759 Jul 14 14:39:34.543939 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 427/845] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:39:34 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:39:34.601032 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-99f7bd0c-e95b-4cfa-9f5e-e17da36997a0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:34.601584 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-99f7bd0c-e95b-4cfa-9f5e-e17da36997a0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:34.608335 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-99f7bd0c-e95b-4cfa-9f5e-e17da36997a0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:34.608783 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-99f7bd0c-e95b-4cfa-9f5e-e17da36997a0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:34.609549 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-99f7bd0c-e95b-4cfa-9f5e-e17da36997a0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:34.610008 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-99f7bd0c-e95b-4cfa-9f5e-e17da36997a0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:34.635879 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-99f7bd0c-e95b-4cfa-9f5e-e17da36997a0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Going to try to terminate instance {{(pid=118462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:39:34.979026 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-99f7bd0c-e95b-4cfa-9f5e-e17da36997a0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "DELETE /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580" status: 204 len: 0 microversion: 2.1 time: 0.380721 Jul 14 14:39:34.979611 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 419/846] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:39:34 2022] DELETE /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:39:34.988099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e671e5cb-45c5-4e31-9750-613ebea0c9a8 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:34.990070 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e671e5cb-45c5-4e31-9750-613ebea0c9a8 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:34.995763 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e671e5cb-45c5-4e31-9750-613ebea0c9a8 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:34.996202 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e671e5cb-45c5-4e31-9750-613ebea0c9a8 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:34.996955 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e671e5cb-45c5-4e31-9750-613ebea0c9a8 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:34.997384 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e671e5cb-45c5-4e31-9750-613ebea0c9a8 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:35.133394 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e671e5cb-45c5-4e31-9750-613ebea0c9a8 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:35.140943 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e671e5cb-45c5-4e31-9750-613ebea0c9a8 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580" status: 200 len: 1681 microversion: 2.1 time: 0.157033 Jul 14 14:39:35.141512 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 428/847] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:34 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:36.158861 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ee64363e-2401-45a9-9952-755c338c159d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:36.159561 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ee64363e-2401-45a9-9952-755c338c159d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:36.166110 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ee64363e-2401-45a9-9952-755c338c159d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:36.166611 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ee64363e-2401-45a9-9952-755c338c159d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:36.167485 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ee64363e-2401-45a9-9952-755c338c159d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:36.167916 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ee64363e-2401-45a9-9952-755c338c159d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:36.299094 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ee64363e-2401-45a9-9952-755c338c159d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:36.307240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ee64363e-2401-45a9-9952-755c338c159d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580" status: 200 len: 1681 microversion: 2.1 time: 0.152105 Jul 14 14:39:36.307810 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 420/848] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:36 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:37.324821 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-130bf2bf-3a4c-43b7-941f-a3afd8b9f040 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:37.325603 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-130bf2bf-3a4c-43b7-941f-a3afd8b9f040 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:37.332785 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-130bf2bf-3a4c-43b7-941f-a3afd8b9f040 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:37.333238 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-130bf2bf-3a4c-43b7-941f-a3afd8b9f040 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:37.334128 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-130bf2bf-3a4c-43b7-941f-a3afd8b9f040 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:37.334568 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-130bf2bf-3a4c-43b7-941f-a3afd8b9f040 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:37.402300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-130bf2bf-3a4c-43b7-941f-a3afd8b9f040 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:37.409857 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-130bf2bf-3a4c-43b7-941f-a3afd8b9f040 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580" status: 200 len: 1613 microversion: 2.1 time: 0.088941 Jul 14 14:39:37.410436 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 429/849] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:37 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 => generated 1613 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:37.524575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-27be59b5-77f5-4deb-b4f6-f8bdfd7d4597 req-69973a4e-82e1-4fe2-a84d-5621b5c1cbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36276a10-ba93-4cae-abe5-f5484419f580", "name": "network-vif-deleted", "tag": "e62f2773-2ec1-41b9-b379-54b3094f80ef"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:37.533640 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-27be59b5-77f5-4deb-b4f6-f8bdfd7d4597 req-69973a4e-82e1-4fe2-a84d-5621b5c1cbc8 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:37.536172 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-27be59b5-77f5-4deb-b4f6-f8bdfd7d4597 req-69973a4e-82e1-4fe2-a84d-5621b5c1cbc8 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:37.548511 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-27be59b5-77f5-4deb-b4f6-f8bdfd7d4597 req-69973a4e-82e1-4fe2-a84d-5621b5c1cbc8 service nova] Creating event network-vif-deleted:e62f2773-2ec1-41b9-b379-54b3094f80ef for instance 36276a10-ba93-4cae-abe5-f5484419f580 on hv-cinder-79987 Jul 14 14:39:37.553308 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-27be59b5-77f5-4deb-b4f6-f8bdfd7d4597 req-69973a4e-82e1-4fe2-a84d-5621b5c1cbc8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032424 Jul 14 14:39:37.554244 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 421/850] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:38.427685 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-107967fc-775a-4a32-a93b-f33493b7ce2a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:38.428298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-107967fc-775a-4a32-a93b-f33493b7ce2a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:38.434866 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-107967fc-775a-4a32-a93b-f33493b7ce2a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:38.435315 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-107967fc-775a-4a32-a93b-f33493b7ce2a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:38.436080 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-107967fc-775a-4a32-a93b-f33493b7ce2a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:38.436515 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-107967fc-775a-4a32-a93b-f33493b7ce2a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:38.469247 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-107967fc-775a-4a32-a93b-f33493b7ce2a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:38.469693 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-107967fc-775a-4a32-a93b-f33493b7ce2a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:38.470166 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.objects.instance [None req-107967fc-775a-4a32-a93b-f33493b7ce2a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lazy-loading 'fault' on Instance uuid 36276a10-ba93-4cae-abe5-f5484419f580 {{(pid=118461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:38.515879 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-107967fc-775a-4a32-a93b-f33493b7ce2a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:38.523588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-107967fc-775a-4a32-a93b-f33493b7ce2a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580" status: 200 len: 1331 microversion: 2.1 time: 0.099852 Jul 14 14:39:38.524153 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 430/851] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:38 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:39.542899 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-77feab5f-7633-40dc-83ae-df48e1e21960 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:39.543589 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-77feab5f-7633-40dc-83ae-df48e1e21960 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:39.549637 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-77feab5f-7633-40dc-83ae-df48e1e21960 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:39.550106 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-77feab5f-7633-40dc-83ae-df48e1e21960 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:39.550915 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-77feab5f-7633-40dc-83ae-df48e1e21960 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:39.551365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-77feab5f-7633-40dc-83ae-df48e1e21960 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:39.564946 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-77feab5f-7633-40dc-83ae-df48e1e21960 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] HTTP exception thrown: Instance 36276a10-ba93-4cae-abe5-f5484419f580 could not be found. Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-77feab5f-7633-40dc-83ae-df48e1e21960 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Request method failure captured: Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 HTTP/1.1 Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0Coo2gQogloRyym-Nd5AKwohPbpaRVZzos2SNok6dsmiCUJQmaykmjw3JyCJGMIH4FxV3wh3mUDSl5SZMVXqBFX7Lk4CWppNzlNQJtOMoX0ubLPJKvnCDDOBuNYnggBOJcheNqaeVxGGln05C89djgP50UkOcd_oy4_GhZ5i307EiWw Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:39:39.566684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:39:39.568274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:39:39.568274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:39:39.568274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:39:39.568274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:39:39.568274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:39:39.568274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:39:39.568274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:39:39.568274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 98f00ffeef484dd489ed67b96d1ed783 Jul 14 14:39:39.568274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:39:39.568274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:39:39.568274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 36276a10-ba93-4cae-abe5-f5484419f580 could not be found. Jul 14 14:39:39.568274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '36276a10-ba93-4cae-abe5-f5484419f580'} Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36276a10-ba93-4cae-abe5-f5484419f580 could not be found. Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:39.569127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:39.570447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:39.570447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:39:39.570447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:39:39.570447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:39:39.570447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:39:39.570447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:39:39.570447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:39:39.570447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36276a10-ba93-4cae-abe5-f5484419f580 could not be found. Jul 14 14:39:39.570447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:39.570447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:39.570447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:39.570447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:39.570447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:39.570447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:39.570447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:39.570447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:39.570447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36276a10-ba93-4cae-abe5-f5484419f580 could not be found. Jul 14 14:39:39.570447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:39:39.571559 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-77feab5f-7633-40dc-83ae-df48e1e21960 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Returning 404 to user: Instance 36276a10-ba93-4cae-abe5-f5484419f580 could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:39.571559 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-77feab5f-7633-40dc-83ae-df48e1e21960 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580" status: 404 len: 111 microversion: 2.1 time: 0.030618 Jul 14 14:39:39.571559 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 422/852] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:39 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:39:39.576982 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-5918717c-6bd8-4754-9bf9-e4ca66a6a2f1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '.version_select at 0x7f415fd4be50>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:39.659029 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-5918717c-6bd8-4754-9bf9-e4ca66a6a2f1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1328268718" status: 202 len: 0 microversion: 2.1 time: 0.085773 Jul 14 14:39:39.659506 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 431/853] 10.222.0.93 () {58 vars in 1220 bytes} [Thu Jul 14 14:39:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1328268718 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:39:40.496011 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-33d5e35a-8e0a-48c2-b227-c944ec24a25c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Action: 'create', calling method: .version_select at 0x7f416c452790>, body: {"keypair": {"name": "tempest-keypair-1293023964", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQEaHPWLnfFRjVFgX97Qr+aSAAdxgAmgqCIvnIJgVb9YR58+Cviy1ikU7LQH2Ns21bc7GaBz+e8rwtM7HKgZtFriLm74Pc4j9AGQOstBjs7++ew3+9koLaYnyivDOv7+A=="}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:40.510318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-33d5e35a-8e0a-48c2-b227-c944ec24a25c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Getting quotas for project abb12869989f45cc875ecb36dd1f7aef. Resources: {'key_pairs'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:40.514099 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-33d5e35a-8e0a-48c2-b227-c944ec24a25c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Getting quotas for user 98f00ffeef484dd489ed67b96d1ed783 and project abb12869989f45cc875ecb36dd1f7aef. Resources: {'key_pairs'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:40.595815 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-33d5e35a-8e0a-48c2-b227-c944ec24a25c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104256 Jul 14 14:39:40.596485 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 423/854] 10.222.0.93 () {60 vars in 1158 bytes} [Thu Jul 14 14:39:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:43.155844 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-6ad65712-2a6d-4596-bf79-b1d32e250b0b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-309940744", "imageRef": "7ea875a4-facb-4053-be2d-ff0080d2f3a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e31486e8-2bc1-4f00-b9ce-bbd86c605e0f"}], "security_groups": [{"name": "tempest-securitygroup--1189257427"}], "key_name": "tempest-keypair-1293023964", "user_data": "}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:43.259672 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.network.neutron [None req-6ad65712-2a6d-4596-bf79-b1d32e250b0b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] validate_networks() for [('e31486e8-2bc1-4f00-b9ce-bbd86c605e0f', None, None, None, None, None)] {{(pid=118461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:39:43.638345 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-6ad65712-2a6d-4596-bf79-b1d32e250b0b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Flavor limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:39:43.638769 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-6ad65712-2a6d-4596-bf79-b1d32e250b0b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Image limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:39:43.639243 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-6ad65712-2a6d-4596-bf79-b1d32e250b0b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Flavor pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:39:43.639651 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-6ad65712-2a6d-4596-bf79-b1d32e250b0b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Image pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:39:43.640196 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-6ad65712-2a6d-4596-bf79-b1d32e250b0b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:39:43.649080 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6ad65712-2a6d-4596-bf79-b1d32e250b0b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:43.649525 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6ad65712-2a6d-4596-bf79-b1d32e250b0b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:43.650876 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6ad65712-2a6d-4596-bf79-b1d32e250b0b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:43.651310 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6ad65712-2a6d-4596-bf79-b1d32e250b0b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:43.668332 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-6ad65712-2a6d-4596-bf79-b1d32e250b0b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Getting quotas for project abb12869989f45cc875ecb36dd1f7aef. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:43.672462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-6ad65712-2a6d-4596-bf79-b1d32e250b0b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Getting quotas for user 98f00ffeef484dd489ed67b96d1ed783 and project abb12869989f45cc875ecb36dd1f7aef. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:43.683563 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-6ad65712-2a6d-4596-bf79-b1d32e250b0b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Going to run 1 instances... {{(pid=118461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:39:43.685881 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-6ad65712-2a6d-4596-bf79-b1d32e250b0b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ea875a4-facb-4053-be2d-ff0080d2f3a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:39:43.854810 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-6ad65712-2a6d-4596-bf79-b1d32e250b0b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.703840 Jul 14 14:39:43.855514 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 432/855] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:39:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:39:43.865364 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0d1324d7-9da0-4fec-97b6-a56a2597e0f9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:43.871800 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0d1324d7-9da0-4fec-97b6-a56a2597e0f9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:43.922756 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-0d1324d7-9da0-4fec-97b6-a56a2597e0f9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:43.929511 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0d1324d7-9da0-4fec-97b6-a56a2597e0f9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a" status: 200 len: 1241 microversion: 2.1 time: 0.067811 Jul 14 14:39:43.933083 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 424/856] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:43 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:44.946799 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-71cba903-d976-4a47-9ac8-b53613e20f5a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:44.947412 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-71cba903-d976-4a47-9ac8-b53613e20f5a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:44.999536 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-71cba903-d976-4a47-9ac8-b53613e20f5a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:45.006272 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-71cba903-d976-4a47-9ac8-b53613e20f5a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a" status: 200 len: 1241 microversion: 2.1 time: 0.063829 Jul 14 14:39:45.006844 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 433/857] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:44 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:46.024044 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-9f9621c6-bdae-49d1-a74f-ff3f98c363e0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:46.024697 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-9f9621c6-bdae-49d1-a74f-ff3f98c363e0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:46.031273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9f9621c6-bdae-49d1-a74f-ff3f98c363e0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:46.031721 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9f9621c6-bdae-49d1-a74f-ff3f98c363e0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:46.032470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9f9621c6-bdae-49d1-a74f-ff3f98c363e0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:46.032896 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9f9621c6-bdae-49d1-a74f-ff3f98c363e0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:46.094373 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-9f9621c6-bdae-49d1-a74f-ff3f98c363e0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:46.101829 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-9f9621c6-bdae-49d1-a74f-ff3f98c363e0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a" status: 200 len: 1293 microversion: 2.1 time: 0.082456 Jul 14 14:39:46.102661 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 425/858] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:46 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:47.119076 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-95827b1c-282b-4b68-9913-19ac378ce72a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:47.119759 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-95827b1c-282b-4b68-9913-19ac378ce72a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:47.127132 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-95827b1c-282b-4b68-9913-19ac378ce72a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:47.127795 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-95827b1c-282b-4b68-9913-19ac378ce72a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:47.128536 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-95827b1c-282b-4b68-9913-19ac378ce72a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:47.128969 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-95827b1c-282b-4b68-9913-19ac378ce72a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:47.435083 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-95827b1c-282b-4b68-9913-19ac378ce72a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:47.443130 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-95827b1c-282b-4b68-9913-19ac378ce72a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a" status: 200 len: 1299 microversion: 2.1 time: 0.327996 Jul 14 14:39:47.444249 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 434/859] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:47 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a => generated 1299 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:48.260471 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-411af43d-a2b6-4ca0-abbd-440432e45476 req-78ce4d49-784a-4124-88ae-7538590c39cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33dbec70-312c-4147-ac5f-5b74f2cfe64a", "tag": "7623ee61-4803-456e-964e-d8c752c8b1cf"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:48.270092 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-411af43d-a2b6-4ca0-abbd-440432e45476 req-78ce4d49-784a-4124-88ae-7538590c39cc service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:48.270523 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-411af43d-a2b6-4ca0-abbd-440432e45476 req-78ce4d49-784a-4124-88ae-7538590c39cc service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:48.283928 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-411af43d-a2b6-4ca0-abbd-440432e45476 req-78ce4d49-784a-4124-88ae-7538590c39cc service nova] Creating event network-changed:7623ee61-4803-456e-964e-d8c752c8b1cf for instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a on hv-cinder-79987 Jul 14 14:39:48.288876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-411af43d-a2b6-4ca0-abbd-440432e45476 req-78ce4d49-784a-4124-88ae-7538590c39cc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032480 Jul 14 14:39:48.289472 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 426/860] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:48.466334 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-dfa96d1d-2507-4bb4-bb0e-c97cc2213b84 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:48.472602 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-dfa96d1d-2507-4bb4-bb0e-c97cc2213b84 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:48.474251 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dfa96d1d-2507-4bb4-bb0e-c97cc2213b84 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:48.475036 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dfa96d1d-2507-4bb4-bb0e-c97cc2213b84 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:48.475914 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dfa96d1d-2507-4bb4-bb0e-c97cc2213b84 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:48.476449 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dfa96d1d-2507-4bb4-bb0e-c97cc2213b84 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:48.607744 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-dfa96d1d-2507-4bb4-bb0e-c97cc2213b84 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:48.615380 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-dfa96d1d-2507-4bb4-bb0e-c97cc2213b84 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a" status: 200 len: 1367 microversion: 2.1 time: 0.154841 Jul 14 14:39:48.615951 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 435/861] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:48 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:49.633238 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b5157335-5257-4030-bacb-73779e07aa83 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:49.634006 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b5157335-5257-4030-bacb-73779e07aa83 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:49.640866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b5157335-5257-4030-bacb-73779e07aa83 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:49.641311 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b5157335-5257-4030-bacb-73779e07aa83 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:49.642095 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b5157335-5257-4030-bacb-73779e07aa83 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:49.642532 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b5157335-5257-4030-bacb-73779e07aa83 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:49.778427 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b5157335-5257-4030-bacb-73779e07aa83 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:49.785839 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b5157335-5257-4030-bacb-73779e07aa83 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a" status: 200 len: 1367 microversion: 2.1 time: 0.157314 Jul 14 14:39:49.786432 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 427/862] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:49 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:50.802781 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-7ae6c0d5-0edc-4dbe-8ded-561acf274b2b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:50.803426 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-7ae6c0d5-0edc-4dbe-8ded-561acf274b2b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:50.810126 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7ae6c0d5-0edc-4dbe-8ded-561acf274b2b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:50.810578 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7ae6c0d5-0edc-4dbe-8ded-561acf274b2b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:50.811342 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7ae6c0d5-0edc-4dbe-8ded-561acf274b2b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:50.811777 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7ae6c0d5-0edc-4dbe-8ded-561acf274b2b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:50.952761 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7ae6c0d5-0edc-4dbe-8ded-561acf274b2b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:50.960330 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-7ae6c0d5-0edc-4dbe-8ded-561acf274b2b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a" status: 200 len: 1367 microversion: 2.1 time: 0.161497 Jul 14 14:39:50.960885 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 436/863] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:50 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:51.978562 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c69db112-290c-4d3b-b6e0-baae400af06e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:51.979175 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c69db112-290c-4d3b-b6e0-baae400af06e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:51.984303 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-e82a334c-9a76-4315-a722-366007723d44 req-6f96a3cc-8880-4c0f-92e7-d71ecb9846a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33dbec70-312c-4147-ac5f-5b74f2cfe64a", "name": "network-vif-plugged", "status": "completed", "tag": "7623ee61-4803-456e-964e-d8c752c8b1cf"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:51.988136 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c69db112-290c-4d3b-b6e0-baae400af06e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:51.988136 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c69db112-290c-4d3b-b6e0-baae400af06e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:51.988136 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c69db112-290c-4d3b-b6e0-baae400af06e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:51.988136 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c69db112-290c-4d3b-b6e0-baae400af06e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:51.994026 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-e82a334c-9a76-4315-a722-366007723d44 req-6f96a3cc-8880-4c0f-92e7-d71ecb9846a9 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:51.994459 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-e82a334c-9a76-4315-a722-366007723d44 req-6f96a3cc-8880-4c0f-92e7-d71ecb9846a9 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:52.008085 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-e82a334c-9a76-4315-a722-366007723d44 req-6f96a3cc-8880-4c0f-92e7-d71ecb9846a9 service nova] Creating event network-vif-plugged:7623ee61-4803-456e-964e-d8c752c8b1cf for instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a on hv-cinder-79987 Jul 14 14:39:52.013163 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-e82a334c-9a76-4315-a722-366007723d44 req-6f96a3cc-8880-4c0f-92e7-d71ecb9846a9 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032698 Jul 14 14:39:52.013956 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 437/864] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:52.120160 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-c69db112-290c-4d3b-b6e0-baae400af06e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:52.127932 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c69db112-290c-4d3b-b6e0-baae400af06e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a" status: 200 len: 1367 microversion: 2.1 time: 0.153995 Jul 14 14:39:52.128507 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 428/865] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:51 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:39:53.145028 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-510a6948-ece6-4792-9327-9c99ec4d9ba2 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:53.145832 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-510a6948-ece6-4792-9327-9c99ec4d9ba2 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:53.153032 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-510a6948-ece6-4792-9327-9c99ec4d9ba2 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:53.153559 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-510a6948-ece6-4792-9327-9c99ec4d9ba2 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:53.154462 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-510a6948-ece6-4792-9327-9c99ec4d9ba2 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:53.154961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-510a6948-ece6-4792-9327-9c99ec4d9ba2 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:53.290315 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-510a6948-ece6-4792-9327-9c99ec4d9ba2 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:53.298455 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-510a6948-ece6-4792-9327-9c99ec4d9ba2 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a" status: 200 len: 1367 microversion: 2.1 time: 0.157729 Jul 14 14:39:53.299027 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 438/866] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:53 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:54.315202 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a6294b48-7215-4830-b9f0-6d27b235e74e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:54.315814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a6294b48-7215-4830-b9f0-6d27b235e74e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:54.318233 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=6 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:54.323702 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a6294b48-7215-4830-b9f0-6d27b235e74e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:54.327316 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a6294b48-7215-4830-b9f0-6d27b235e74e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:54.327316 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a6294b48-7215-4830-b9f0-6d27b235e74e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:54.327316 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a6294b48-7215-4830-b9f0-6d27b235e74e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:54.452365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a6294b48-7215-4830-b9f0-6d27b235e74e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:54.459882 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a6294b48-7215-4830-b9f0-6d27b235e74e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a" status: 200 len: 1557 microversion: 2.1 time: 0.148571 Jul 14 14:39:54.460449 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 429/867] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:54 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:54.476242 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-6386a44d-4018-4f18-814c-09448fd6267f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:54.477582 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-6386a44d-4018-4f18-814c-09448fd6267f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:54.479472 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:54.484782 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6386a44d-4018-4f18-814c-09448fd6267f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:54.485228 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6386a44d-4018-4f18-814c-09448fd6267f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:54.486116 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6386a44d-4018-4f18-814c-09448fd6267f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:54.486619 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6386a44d-4018-4f18-814c-09448fd6267f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:54.564625 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-6386a44d-4018-4f18-814c-09448fd6267f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092225 Jul 14 14:39:54.565267 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 439/868] 10.222.0.93 () {58 vars in 1274 bytes} [Thu Jul 14 14:39:54 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:55.621431 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-fac707a2-ba18-43b4-bb5c-2ae4b3ef42b2 req-be22eccd-80a0-4c3f-9e36-5f21ba8a159b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33dbec70-312c-4147-ac5f-5b74f2cfe64a", "tag": "7623ee61-4803-456e-964e-d8c752c8b1cf"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:55.629756 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-fac707a2-ba18-43b4-bb5c-2ae4b3ef42b2 req-be22eccd-80a0-4c3f-9e36-5f21ba8a159b service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:55.630278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-fac707a2-ba18-43b4-bb5c-2ae4b3ef42b2 req-be22eccd-80a0-4c3f-9e36-5f21ba8a159b service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:55.644331 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-fac707a2-ba18-43b4-bb5c-2ae4b3ef42b2 req-be22eccd-80a0-4c3f-9e36-5f21ba8a159b service nova] Creating event network-changed:7623ee61-4803-456e-964e-d8c752c8b1cf for instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a on hv-cinder-79987 Jul 14 14:39:55.649213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-fac707a2-ba18-43b4-bb5c-2ae4b3ef42b2 req-be22eccd-80a0-4c3f-9e36-5f21ba8a159b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032161 Jul 14 14:39:55.649838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 430/869] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:00.416817 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=8 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:00.421280 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-faa5c874-a7c9-43a1-9891-a72905d4bc4c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:00.421762 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-faa5c874-a7c9-43a1-9891-a72905d4bc4c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:00.427730 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-faa5c874-a7c9-43a1-9891-a72905d4bc4c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:00.441601 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-faa5c874-a7c9-43a1-9891-a72905d4bc4c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:00.441601 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-faa5c874-a7c9-43a1-9891-a72905d4bc4c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:00.441601 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-faa5c874-a7c9-43a1-9891-a72905d4bc4c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:00.441601 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:00.453022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-faa5c874-a7c9-43a1-9891-a72905d4bc4c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd/ips" status: 200 len: 152 microversion: 2.20 time: 0.036987 Jul 14 14:40:00.453589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 440/870] 10.222.0.93 () {60 vars in 1288 bytes} [Thu Jul 14 14:40:00 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:40:02.774645 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-41abd4c8-95e8-4005-a447-a24964417b08 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:02.775265 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-41abd4c8-95e8-4005-a447-a24964417b08 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:02.777179 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:02.782100 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-41abd4c8-95e8-4005-a447-a24964417b08 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:02.782551 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-41abd4c8-95e8-4005-a447-a24964417b08 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:02.783310 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-41abd4c8-95e8-4005-a447-a24964417b08 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:02.783745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-41abd4c8-95e8-4005-a447-a24964417b08 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:02.787314 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:02.805597 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-41abd4c8-95e8-4005-a447-a24964417b08 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lazy-loading 'flavor' on Instance uuid 8bad9638-c252-4901-8de1-beeaf6a59bbd {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:40:03.440000 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-41abd4c8-95e8-4005-a447-a24964417b08 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "POST /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd/action" status: 202 len: 0 microversion: 2.20 time: 0.670794 Jul 14 14:40:03.440686 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 431/871] 10.222.0.93 () {62 vars in 1318 bytes} [Thu Jul 14 14:40:02 2022] POST /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd/action => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:40:03.448938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-3d7d59ec-a6e7-4084-adae-c9e323964470 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:03.449547 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-3d7d59ec-a6e7-4084-adae-c9e323964470 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:03.457351 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3d7d59ec-a6e7-4084-adae-c9e323964470 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:03.457821 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3d7d59ec-a6e7-4084-adae-c9e323964470 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:03.458785 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3d7d59ec-a6e7-4084-adae-c9e323964470 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:03.459295 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3d7d59ec-a6e7-4084-adae-c9e323964470 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:03.598287 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3d7d59ec-a6e7-4084-adae-c9e323964470 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:03.607406 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3d7d59ec-a6e7-4084-adae-c9e323964470 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:03.608937 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3d7d59ec-a6e7-4084-adae-c9e323964470 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:03.610153 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-3d7d59ec-a6e7-4084-adae-c9e323964470 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1724 microversion: 2.20 time: 0.165271 Jul 14 14:40:03.610712 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 441/872] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:03 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:04.629604 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e1850285-1772-4985-9b4f-0997b01594c3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:04.630428 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e1850285-1772-4985-9b4f-0997b01594c3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:04.637575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e1850285-1772-4985-9b4f-0997b01594c3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:04.638056 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e1850285-1772-4985-9b4f-0997b01594c3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:04.638819 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e1850285-1772-4985-9b4f-0997b01594c3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:04.639247 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e1850285-1772-4985-9b4f-0997b01594c3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:04.769795 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e1850285-1772-4985-9b4f-0997b01594c3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:04.777884 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e1850285-1772-4985-9b4f-0997b01594c3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:04.779434 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e1850285-1772-4985-9b4f-0997b01594c3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:04.780596 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e1850285-1772-4985-9b4f-0997b01594c3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1724 microversion: 2.20 time: 0.155880 Jul 14 14:40:04.781143 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 432/873] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:04 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:05.799447 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b936aa59-04c7-4169-92c0-63e49b733c60 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:05.800026 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b936aa59-04c7-4169-92c0-63e49b733c60 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:05.807183 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b936aa59-04c7-4169-92c0-63e49b733c60 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:05.807623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b936aa59-04c7-4169-92c0-63e49b733c60 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:05.808376 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b936aa59-04c7-4169-92c0-63e49b733c60 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:05.808800 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b936aa59-04c7-4169-92c0-63e49b733c60 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:05.935276 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b936aa59-04c7-4169-92c0-63e49b733c60 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:05.943240 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b936aa59-04c7-4169-92c0-63e49b733c60 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:05.944738 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b936aa59-04c7-4169-92c0-63e49b733c60 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:05.945906 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b936aa59-04c7-4169-92c0-63e49b733c60 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1724 microversion: 2.20 time: 0.150352 Jul 14 14:40:05.946459 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 442/874] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:05 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:06.964459 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-bcfcd322-ad53-4998-866e-deac04d7eddf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:06.964989 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-bcfcd322-ad53-4998-866e-deac04d7eddf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:06.971609 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bcfcd322-ad53-4998-866e-deac04d7eddf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:06.972084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bcfcd322-ad53-4998-866e-deac04d7eddf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:06.972846 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bcfcd322-ad53-4998-866e-deac04d7eddf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:06.973282 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-bcfcd322-ad53-4998-866e-deac04d7eddf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:07.107701 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-bcfcd322-ad53-4998-866e-deac04d7eddf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:07.115634 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-bcfcd322-ad53-4998-866e-deac04d7eddf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:07.117165 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-bcfcd322-ad53-4998-866e-deac04d7eddf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:07.118332 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-bcfcd322-ad53-4998-866e-deac04d7eddf tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1724 microversion: 2.20 time: 0.158407 Jul 14 14:40:07.118890 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 433/875] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:06 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:08.137302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d5493386-c56b-4d36-a544-159b25955610 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:08.137953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d5493386-c56b-4d36-a544-159b25955610 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:08.140274 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:08.145338 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d5493386-c56b-4d36-a544-159b25955610 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:08.145802 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d5493386-c56b-4d36-a544-159b25955610 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:08.149194 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d5493386-c56b-4d36-a544-159b25955610 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:08.149194 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d5493386-c56b-4d36-a544-159b25955610 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:08.276327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d5493386-c56b-4d36-a544-159b25955610 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:08.284179 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d5493386-c56b-4d36-a544-159b25955610 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:08.285742 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d5493386-c56b-4d36-a544-159b25955610 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:08.286919 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d5493386-c56b-4d36-a544-159b25955610 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1724 microversion: 2.20 time: 0.154227 Jul 14 14:40:08.287485 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 443/876] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:08 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:40:09.305643 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-27a98573-8eb2-4365-8c84-328ea3c0e11b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:09.306247 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-27a98573-8eb2-4365-8c84-328ea3c0e11b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:09.312646 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-27a98573-8eb2-4365-8c84-328ea3c0e11b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:09.313081 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-27a98573-8eb2-4365-8c84-328ea3c0e11b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:09.313881 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-27a98573-8eb2-4365-8c84-328ea3c0e11b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:09.314348 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-27a98573-8eb2-4365-8c84-328ea3c0e11b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:09.449859 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-27a98573-8eb2-4365-8c84-328ea3c0e11b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:09.457671 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-27a98573-8eb2-4365-8c84-328ea3c0e11b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:09.459198 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-27a98573-8eb2-4365-8c84-328ea3c0e11b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:09.460331 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-27a98573-8eb2-4365-8c84-328ea3c0e11b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1724 microversion: 2.20 time: 0.159127 Jul 14 14:40:09.460871 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 434/877] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:09 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:10.479183 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-2bb5fe1e-c947-4f30-aa03-a3ca5da825ce tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:10.479734 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-2bb5fe1e-c947-4f30-aa03-a3ca5da825ce tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:10.486353 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2bb5fe1e-c947-4f30-aa03-a3ca5da825ce tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:10.486795 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2bb5fe1e-c947-4f30-aa03-a3ca5da825ce tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:10.487549 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2bb5fe1e-c947-4f30-aa03-a3ca5da825ce tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:10.487976 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-2bb5fe1e-c947-4f30-aa03-a3ca5da825ce tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:10.615879 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-2bb5fe1e-c947-4f30-aa03-a3ca5da825ce tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:10.623775 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-2bb5fe1e-c947-4f30-aa03-a3ca5da825ce tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:10.625286 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-2bb5fe1e-c947-4f30-aa03-a3ca5da825ce tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:10.626486 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-2bb5fe1e-c947-4f30-aa03-a3ca5da825ce tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1724 microversion: 2.20 time: 0.152001 Jul 14 14:40:10.627036 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 444/878] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:10 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:11.644566 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-65c29a49-7762-4969-a6cd-0141e0eb015f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:11.645164 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-65c29a49-7762-4969-a6cd-0141e0eb015f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:11.653071 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-65c29a49-7762-4969-a6cd-0141e0eb015f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:11.653513 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-65c29a49-7762-4969-a6cd-0141e0eb015f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:11.654303 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-65c29a49-7762-4969-a6cd-0141e0eb015f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:11.654739 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-65c29a49-7762-4969-a6cd-0141e0eb015f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:11.784982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-65c29a49-7762-4969-a6cd-0141e0eb015f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:11.792782 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-65c29a49-7762-4969-a6cd-0141e0eb015f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:11.794305 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-65c29a49-7762-4969-a6cd-0141e0eb015f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:11.795442 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-65c29a49-7762-4969-a6cd-0141e0eb015f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1724 microversion: 2.20 time: 0.154960 Jul 14 14:40:11.795986 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 435/879] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:11 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:12.813442 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-fdbdd87d-11e3-47a7-aadb-257eb17c5c7d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:12.814073 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-fdbdd87d-11e3-47a7-aadb-257eb17c5c7d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:12.820305 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fdbdd87d-11e3-47a7-aadb-257eb17c5c7d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:12.820739 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fdbdd87d-11e3-47a7-aadb-257eb17c5c7d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:12.821481 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fdbdd87d-11e3-47a7-aadb-257eb17c5c7d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:12.821944 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fdbdd87d-11e3-47a7-aadb-257eb17c5c7d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:12.950139 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-fdbdd87d-11e3-47a7-aadb-257eb17c5c7d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:12.958120 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-fdbdd87d-11e3-47a7-aadb-257eb17c5c7d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:12.959640 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-fdbdd87d-11e3-47a7-aadb-257eb17c5c7d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:12.961301 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-fdbdd87d-11e3-47a7-aadb-257eb17c5c7d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1724 microversion: 2.20 time: 0.152024 Jul 14 14:40:12.961871 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 445/880] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:12 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:13.979878 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b27b4670-3269-47f9-925f-a3401a0dfcdd tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:13.980480 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b27b4670-3269-47f9-925f-a3401a0dfcdd tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:13.987002 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b27b4670-3269-47f9-925f-a3401a0dfcdd tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:13.987442 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b27b4670-3269-47f9-925f-a3401a0dfcdd tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:13.988190 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b27b4670-3269-47f9-925f-a3401a0dfcdd tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:13.988620 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b27b4670-3269-47f9-925f-a3401a0dfcdd tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:14.131729 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b27b4670-3269-47f9-925f-a3401a0dfcdd tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:14.140010 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b27b4670-3269-47f9-925f-a3401a0dfcdd tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:14.141498 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b27b4670-3269-47f9-925f-a3401a0dfcdd tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:14.142654 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b27b4670-3269-47f9-925f-a3401a0dfcdd tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1724 microversion: 2.20 time: 0.167162 Jul 14 14:40:14.143201 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 436/881] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:13 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:15.161342 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b99ce32a-8490-4cfe-ae9e-712d155816f6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:15.161958 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b99ce32a-8490-4cfe-ae9e-712d155816f6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:15.168581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b99ce32a-8490-4cfe-ae9e-712d155816f6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:15.169022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b99ce32a-8490-4cfe-ae9e-712d155816f6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:15.169804 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b99ce32a-8490-4cfe-ae9e-712d155816f6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:15.170238 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b99ce32a-8490-4cfe-ae9e-712d155816f6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:15.302107 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b99ce32a-8490-4cfe-ae9e-712d155816f6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:15.310617 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b99ce32a-8490-4cfe-ae9e-712d155816f6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:15.312116 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b99ce32a-8490-4cfe-ae9e-712d155816f6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:15.313270 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b99ce32a-8490-4cfe-ae9e-712d155816f6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1724 microversion: 2.20 time: 0.155978 Jul 14 14:40:15.313927 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 446/882] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:15 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:16.332154 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-72fbe674-149d-4a65-89fa-0ff4bfbd7b1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:16.332694 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-72fbe674-149d-4a65-89fa-0ff4bfbd7b1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:16.339189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-72fbe674-149d-4a65-89fa-0ff4bfbd7b1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:16.339633 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-72fbe674-149d-4a65-89fa-0ff4bfbd7b1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:16.340380 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-72fbe674-149d-4a65-89fa-0ff4bfbd7b1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:16.340808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-72fbe674-149d-4a65-89fa-0ff4bfbd7b1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:16.466416 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-72fbe674-149d-4a65-89fa-0ff4bfbd7b1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:16.474406 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-72fbe674-149d-4a65-89fa-0ff4bfbd7b1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:16.476454 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-72fbe674-149d-4a65-89fa-0ff4bfbd7b1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:16.477596 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-72fbe674-149d-4a65-89fa-0ff4bfbd7b1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1724 microversion: 2.20 time: 0.149546 Jul 14 14:40:16.478199 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 437/883] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:16 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:17.496500 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-18bf5a28-74bd-4f95-80e0-241d98b41ba3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:17.497155 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-18bf5a28-74bd-4f95-80e0-241d98b41ba3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:17.503962 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-18bf5a28-74bd-4f95-80e0-241d98b41ba3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:17.504406 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-18bf5a28-74bd-4f95-80e0-241d98b41ba3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:17.505157 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-18bf5a28-74bd-4f95-80e0-241d98b41ba3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:17.505583 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-18bf5a28-74bd-4f95-80e0-241d98b41ba3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:17.637475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-18bf5a28-74bd-4f95-80e0-241d98b41ba3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:17.645450 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-18bf5a28-74bd-4f95-80e0-241d98b41ba3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:17.647007 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-18bf5a28-74bd-4f95-80e0-241d98b41ba3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:17.648151 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-18bf5a28-74bd-4f95-80e0-241d98b41ba3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1724 microversion: 2.20 time: 0.155752 Jul 14 14:40:17.648701 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 447/884] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:17 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:18.666473 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f675cc5e-53f7-4043-b3e7-ae14e9d2a4fb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:18.667127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f675cc5e-53f7-4043-b3e7-ae14e9d2a4fb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:18.673477 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f675cc5e-53f7-4043-b3e7-ae14e9d2a4fb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:18.673962 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f675cc5e-53f7-4043-b3e7-ae14e9d2a4fb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:18.674708 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f675cc5e-53f7-4043-b3e7-ae14e9d2a4fb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:18.675136 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f675cc5e-53f7-4043-b3e7-ae14e9d2a4fb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:18.800770 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f675cc5e-53f7-4043-b3e7-ae14e9d2a4fb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:18.809136 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f675cc5e-53f7-4043-b3e7-ae14e9d2a4fb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:18.810675 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f675cc5e-53f7-4043-b3e7-ae14e9d2a4fb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:18.811814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f675cc5e-53f7-4043-b3e7-ae14e9d2a4fb tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1724 microversion: 2.20 time: 0.149284 Jul 14 14:40:18.812372 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 438/885] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:18 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:19.831086 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-77f4d3e2-bc64-4e8a-850b-88c716b87264 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:19.831683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-77f4d3e2-bc64-4e8a-850b-88c716b87264 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:19.838948 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-77f4d3e2-bc64-4e8a-850b-88c716b87264 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:19.839388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-77f4d3e2-bc64-4e8a-850b-88c716b87264 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:19.840145 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-77f4d3e2-bc64-4e8a-850b-88c716b87264 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:19.840573 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-77f4d3e2-bc64-4e8a-850b-88c716b87264 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:19.972446 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-77f4d3e2-bc64-4e8a-850b-88c716b87264 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:19.980722 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-77f4d3e2-bc64-4e8a-850b-88c716b87264 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:19.982270 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-77f4d3e2-bc64-4e8a-850b-88c716b87264 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:19.983445 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-77f4d3e2-bc64-4e8a-850b-88c716b87264 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1745 microversion: 2.20 time: 0.156402 Jul 14 14:40:19.984011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 448/886] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:19 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:21.001938 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b58375b5-0635-4a40-9921-312b8c151d50 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:21.002546 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b58375b5-0635-4a40-9921-312b8c151d50 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:21.009554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b58375b5-0635-4a40-9921-312b8c151d50 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:21.010032 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b58375b5-0635-4a40-9921-312b8c151d50 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:21.010801 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b58375b5-0635-4a40-9921-312b8c151d50 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:21.011234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b58375b5-0635-4a40-9921-312b8c151d50 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:21.145631 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b58375b5-0635-4a40-9921-312b8c151d50 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:21.150565 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b58375b5-0635-4a40-9921-312b8c151d50 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:21.152134 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b58375b5-0635-4a40-9921-312b8c151d50 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:21.153311 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b58375b5-0635-4a40-9921-312b8c151d50 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1745 microversion: 2.20 time: 0.155373 Jul 14 14:40:21.153873 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 439/887] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:20 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:22.035439 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-14365980-8448-4066-be83-6830c9d84e96 req-81650a31-5e9d-4174-b518-cf6b5f453bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bad9638-c252-4901-8de1-beeaf6a59bbd", "name": "network-vif-plugged", "status": "completed", "tag": "ee6ee1a4-93da-4c93-9496-0e46449759f1"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:22.051729 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-14365980-8448-4066-be83-6830c9d84e96 req-81650a31-5e9d-4174-b518-cf6b5f453bc4 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:22.058526 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-14365980-8448-4066-be83-6830c9d84e96 req-81650a31-5e9d-4174-b518-cf6b5f453bc4 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:22.065177 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-14365980-8448-4066-be83-6830c9d84e96 req-81650a31-5e9d-4174-b518-cf6b5f453bc4 service nova] Creating event network-vif-plugged:ee6ee1a4-93da-4c93-9496-0e46449759f1 for instance 8bad9638-c252-4901-8de1-beeaf6a59bbd on hv-cinder-79987 Jul 14 14:40:22.070594 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-14365980-8448-4066-be83-6830c9d84e96 req-81650a31-5e9d-4174-b518-cf6b5f453bc4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039294 Jul 14 14:40:22.071517 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 449/888] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:22.172038 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7a8e4d76-49d2-435b-b77e-94961a736b74 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:22.173417 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-7a8e4d76-49d2-435b-b77e-94961a736b74 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:22.186327 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7a8e4d76-49d2-435b-b77e-94961a736b74 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:22.189597 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7a8e4d76-49d2-435b-b77e-94961a736b74 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:22.189597 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7a8e4d76-49d2-435b-b77e-94961a736b74 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:22.189597 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7a8e4d76-49d2-435b-b77e-94961a736b74 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:22.354735 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7a8e4d76-49d2-435b-b77e-94961a736b74 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:22.366684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7a8e4d76-49d2-435b-b77e-94961a736b74 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:22.368210 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7a8e4d76-49d2-435b-b77e-94961a736b74 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:22.369380 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-7a8e4d76-49d2-435b-b77e-94961a736b74 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1740 microversion: 2.20 time: 0.201301 Jul 14 14:40:22.369960 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 440/889] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:22 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:23.392214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-7fe8d269-52ad-4b3a-945a-d842b2ce891c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:23.393674 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-7fe8d269-52ad-4b3a-945a-d842b2ce891c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:23.400980 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7fe8d269-52ad-4b3a-945a-d842b2ce891c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:23.401544 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7fe8d269-52ad-4b3a-945a-d842b2ce891c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:23.403393 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7fe8d269-52ad-4b3a-945a-d842b2ce891c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:23.404795 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7fe8d269-52ad-4b3a-945a-d842b2ce891c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:23.553958 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7fe8d269-52ad-4b3a-945a-d842b2ce891c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:23.567381 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7fe8d269-52ad-4b3a-945a-d842b2ce891c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:23.568953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7fe8d269-52ad-4b3a-945a-d842b2ce891c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:23.570840 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-7fe8d269-52ad-4b3a-945a-d842b2ce891c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1740 microversion: 2.20 time: 0.183681 Jul 14 14:40:23.571401 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 450/890] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:23 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:24.589484 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-9a111372-90c2-4f1d-a78a-ee29f15c9f12 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:24.590275 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-9a111372-90c2-4f1d-a78a-ee29f15c9f12 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:24.596895 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9a111372-90c2-4f1d-a78a-ee29f15c9f12 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:24.597348 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9a111372-90c2-4f1d-a78a-ee29f15c9f12 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:24.598200 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9a111372-90c2-4f1d-a78a-ee29f15c9f12 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:24.598637 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9a111372-90c2-4f1d-a78a-ee29f15c9f12 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:24.748523 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-9a111372-90c2-4f1d-a78a-ee29f15c9f12 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:24.758472 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-9a111372-90c2-4f1d-a78a-ee29f15c9f12 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:24.760010 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-9a111372-90c2-4f1d-a78a-ee29f15c9f12 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:24.761149 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-9a111372-90c2-4f1d-a78a-ee29f15c9f12 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1740 microversion: 2.20 time: 0.176270 Jul 14 14:40:24.761701 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 441/891] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:24 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:25.784214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e44843c9-2727-4533-9bfd-84981d2d894a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:25.785223 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e44843c9-2727-4533-9bfd-84981d2d894a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:25.795937 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e44843c9-2727-4533-9bfd-84981d2d894a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:25.796477 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e44843c9-2727-4533-9bfd-84981d2d894a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:25.797351 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e44843c9-2727-4533-9bfd-84981d2d894a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:25.797915 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e44843c9-2727-4533-9bfd-84981d2d894a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:25.959051 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e44843c9-2727-4533-9bfd-84981d2d894a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:25.968338 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e44843c9-2727-4533-9bfd-84981d2d894a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:25.970039 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-e44843c9-2727-4533-9bfd-84981d2d894a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:25.971587 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e44843c9-2727-4533-9bfd-84981d2d894a tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1740 microversion: 2.20 time: 0.194381 Jul 14 14:40:25.983074 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 451/892] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:25 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:26.989135 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7a33ec12-e87d-42d4-99ac-e9b3bb067ae0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:26.989754 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-7a33ec12-e87d-42d4-99ac-e9b3bb067ae0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:26.997908 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7a33ec12-e87d-42d4-99ac-e9b3bb067ae0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:26.998365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7a33ec12-e87d-42d4-99ac-e9b3bb067ae0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:26.999144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7a33ec12-e87d-42d4-99ac-e9b3bb067ae0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:26.999598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7a33ec12-e87d-42d4-99ac-e9b3bb067ae0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:27.148371 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7a33ec12-e87d-42d4-99ac-e9b3bb067ae0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:27.157571 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7a33ec12-e87d-42d4-99ac-e9b3bb067ae0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:27.159249 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7a33ec12-e87d-42d4-99ac-e9b3bb067ae0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:27.160667 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-7a33ec12-e87d-42d4-99ac-e9b3bb067ae0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1740 microversion: 2.20 time: 0.175480 Jul 14 14:40:27.161419 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 442/893] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:26 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:28.180448 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-26d88499-8c94-450d-a19d-637d33b727b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:28.180988 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-26d88499-8c94-450d-a19d-637d33b727b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:28.187952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-26d88499-8c94-450d-a19d-637d33b727b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:28.188415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-26d88499-8c94-450d-a19d-637d33b727b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:28.189186 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-26d88499-8c94-450d-a19d-637d33b727b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:28.189621 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-26d88499-8c94-450d-a19d-637d33b727b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:28.340153 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-26d88499-8c94-450d-a19d-637d33b727b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:28.351076 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-26d88499-8c94-450d-a19d-637d33b727b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:28.352598 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-26d88499-8c94-450d-a19d-637d33b727b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:28.353798 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-26d88499-8c94-450d-a19d-637d33b727b7 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1740 microversion: 2.20 time: 0.177928 Jul 14 14:40:28.354364 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 452/894] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:28 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:29.372698 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-909148b5-6bbf-491e-a300-242f5cdede03 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:29.373262 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-909148b5-6bbf-491e-a300-242f5cdede03 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:29.380230 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-909148b5-6bbf-491e-a300-242f5cdede03 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:29.381066 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-909148b5-6bbf-491e-a300-242f5cdede03 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:29.382590 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-909148b5-6bbf-491e-a300-242f5cdede03 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:29.383220 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-909148b5-6bbf-491e-a300-242f5cdede03 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:29.527545 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-909148b5-6bbf-491e-a300-242f5cdede03 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:29.536437 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-909148b5-6bbf-491e-a300-242f5cdede03 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:29.538057 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-909148b5-6bbf-491e-a300-242f5cdede03 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:29.539272 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-909148b5-6bbf-491e-a300-242f5cdede03 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1740 microversion: 2.20 time: 0.170488 Jul 14 14:40:29.541820 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 443/895] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:29 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:30.478703 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a86ec0bb-7e4c-4f79-b9ab-6d7d40063884 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:30.479317 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a86ec0bb-7e4c-4f79-b9ab-6d7d40063884 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:30.485841 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a86ec0bb-7e4c-4f79-b9ab-6d7d40063884 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:30.486292 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a86ec0bb-7e4c-4f79-b9ab-6d7d40063884 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:30.487046 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a86ec0bb-7e4c-4f79-b9ab-6d7d40063884 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:30.487478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a86ec0bb-7e4c-4f79-b9ab-6d7d40063884 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:30.511167 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a86ec0bb-7e4c-4f79-b9ab-6d7d40063884 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a/ips" status: 200 len: 150 microversion: 2.1 time: 0.036684 Jul 14 14:40:30.511727 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 453/896] 10.222.0.93 () {58 vars in 1247 bytes} [Thu Jul 14 14:40:30 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:30.560839 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-00d53bef-6089-44b5-81ea-5afa0ff9a104 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:30.582078 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-00d53bef-6089-44b5-81ea-5afa0ff9a104 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:30.582078 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-00d53bef-6089-44b5-81ea-5afa0ff9a104 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:30.582078 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-00d53bef-6089-44b5-81ea-5afa0ff9a104 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:30.582078 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-00d53bef-6089-44b5-81ea-5afa0ff9a104 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:30.582511 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-00d53bef-6089-44b5-81ea-5afa0ff9a104 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:30.704944 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-00d53bef-6089-44b5-81ea-5afa0ff9a104 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:30.713491 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-00d53bef-6089-44b5-81ea-5afa0ff9a104 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:30.715062 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-00d53bef-6089-44b5-81ea-5afa0ff9a104 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:30.716199 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-00d53bef-6089-44b5-81ea-5afa0ff9a104 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1740 microversion: 2.20 time: 0.162062 Jul 14 14:40:30.716750 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 444/897] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:30 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:31.734418 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-68d40deb-2a3a-4542-b215-23719037bd93 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:31.735020 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-68d40deb-2a3a-4542-b215-23719037bd93 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:31.741437 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-68d40deb-2a3a-4542-b215-23719037bd93 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:31.741913 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-68d40deb-2a3a-4542-b215-23719037bd93 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:31.742677 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-68d40deb-2a3a-4542-b215-23719037bd93 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:31.743102 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-68d40deb-2a3a-4542-b215-23719037bd93 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:31.887401 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-68d40deb-2a3a-4542-b215-23719037bd93 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:31.895762 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-68d40deb-2a3a-4542-b215-23719037bd93 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:31.897947 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-68d40deb-2a3a-4542-b215-23719037bd93 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:31.899092 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-68d40deb-2a3a-4542-b215-23719037bd93 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1740 microversion: 2.20 time: 0.168540 Jul 14 14:40:31.899635 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 454/898] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:31 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:32.245610 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c3fa4032-4d9c-4f63-a4b7-545453e1707c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd25d583-9e87-4931-ac27-da5b25a63b98"}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:32.247042 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c3fa4032-4d9c-4f63-a4b7-545453e1707c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:32.254154 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c3fa4032-4d9c-4f63-a4b7-545453e1707c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:32.254154 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c3fa4032-4d9c-4f63-a4b7-545453e1707c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:32.254794 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c3fa4032-4d9c-4f63-a4b7-545453e1707c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:32.255220 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c3fa4032-4d9c-4f63-a4b7-545453e1707c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:32.324929 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:32.916886 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-5cdaad3c-2e45-4830-b3a7-1d11ef5042f8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:32.917505 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-5cdaad3c-2e45-4830-b3a7-1d11ef5042f8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:32.926476 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5cdaad3c-2e45-4830-b3a7-1d11ef5042f8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:32.926927 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5cdaad3c-2e45-4830-b3a7-1d11ef5042f8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:32.927700 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5cdaad3c-2e45-4830-b3a7-1d11ef5042f8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:32.928198 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5cdaad3c-2e45-4830-b3a7-1d11ef5042f8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:33.061286 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5cdaad3c-2e45-4830-b3a7-1d11ef5042f8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:33.071794 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5cdaad3c-2e45-4830-b3a7-1d11ef5042f8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:33.073312 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5cdaad3c-2e45-4830-b3a7-1d11ef5042f8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:33.074514 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-5cdaad3c-2e45-4830-b3a7-1d11ef5042f8 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1722 microversion: 2.20 time: 0.161646 Jul 14 14:40:33.082688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 455/899] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:32 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:33.562246 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c3fa4032-4d9c-4f63-a4b7-545453e1707c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "POST /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.320332 Jul 14 14:40:33.562984 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 445/900] 10.222.0.93 () {60 vars in 1322 bytes} [Thu Jul 14 14:40:32 2022] POST /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a/os-volume_attachments => generated 194 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:34.092883 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-26525a1d-bc8f-4d18-bac3-e69e84067485 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:34.093480 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-26525a1d-bc8f-4d18-bac3-e69e84067485 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:34.100632 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-26525a1d-bc8f-4d18-bac3-e69e84067485 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:34.101071 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-26525a1d-bc8f-4d18-bac3-e69e84067485 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:34.101844 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-26525a1d-bc8f-4d18-bac3-e69e84067485 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:34.102271 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-26525a1d-bc8f-4d18-bac3-e69e84067485 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:34.104872 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=88 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:34.236571 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-26525a1d-bc8f-4d18-bac3-e69e84067485 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:34.244994 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-26525a1d-bc8f-4d18-bac3-e69e84067485 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:34.246556 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-26525a1d-bc8f-4d18-bac3-e69e84067485 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:34.247738 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-26525a1d-bc8f-4d18-bac3-e69e84067485 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1722 microversion: 2.20 time: 0.158825 Jul 14 14:40:34.248297 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 456/901] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:34 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:35.266717 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ea3b5f9b-812e-4f0a-bc91-755504b67cb4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:35.267418 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ea3b5f9b-812e-4f0a-bc91-755504b67cb4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:35.269369 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=30 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:35.274835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ea3b5f9b-812e-4f0a-bc91-755504b67cb4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:35.275313 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ea3b5f9b-812e-4f0a-bc91-755504b67cb4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:35.276081 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ea3b5f9b-812e-4f0a-bc91-755504b67cb4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:35.276516 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ea3b5f9b-812e-4f0a-bc91-755504b67cb4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:35.410948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ea3b5f9b-812e-4f0a-bc91-755504b67cb4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:35.419620 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ea3b5f9b-812e-4f0a-bc91-755504b67cb4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:35.421143 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ea3b5f9b-812e-4f0a-bc91-755504b67cb4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:35.422424 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ea3b5f9b-812e-4f0a-bc91-755504b67cb4 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1725 microversion: 2.20 time: 0.160722 Jul 14 14:40:35.422983 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 446/902] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:35 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:35.447373 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-374afbd4-4b6c-44d5-ba2a-a5ca0a76d70d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "927a350f-b7c5-4bbf-9413-1fb36de22199"}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:35.448424 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-374afbd4-4b6c-44d5-ba2a-a5ca0a76d70d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:35.454864 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-374afbd4-4b6c-44d5-ba2a-a5ca0a76d70d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:35.455319 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-374afbd4-4b6c-44d5-ba2a-a5ca0a76d70d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:35.456104 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-374afbd4-4b6c-44d5-ba2a-a5ca0a76d70d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:35.456537 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-374afbd4-4b6c-44d5-ba2a-a5ca0a76d70d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:36.090969 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-751b6bdd-12b8-42bc-a874-a0843c7a3576 req-02fce5d7-35e3-4102-9ca9-b148e0e9eeaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bad9638-c252-4901-8de1-beeaf6a59bbd", "name": "network-vif-unplugged", "status": "completed", "tag": "ee6ee1a4-93da-4c93-9496-0e46449759f1"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:36.099195 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-751b6bdd-12b8-42bc-a874-a0843c7a3576 req-02fce5d7-35e3-4102-9ca9-b148e0e9eeaa service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:36.110587 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-751b6bdd-12b8-42bc-a874-a0843c7a3576 req-02fce5d7-35e3-4102-9ca9-b148e0e9eeaa service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:36.110861 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.compute.server_external_events [req-751b6bdd-12b8-42bc-a874-a0843c7a3576 req-02fce5d7-35e3-4102-9ca9-b148e0e9eeaa service nova] Unable to find a host for instance 8bad9638-c252-4901-8de1-beeaf6a59bbd. Dropping event network-vif-unplugged {{(pid=118462) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 14:40:36.111734 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-751b6bdd-12b8-42bc-a874-a0843c7a3576 req-02fce5d7-35e3-4102-9ca9-b148e0e9eeaa service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024971 Jul 14 14:40:36.112313 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 447/903] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 14 14:40:36.762925 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-374afbd4-4b6c-44d5-ba2a-a5ca0a76d70d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "POST /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.319641 Jul 14 14:40:36.763727 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 457/904] 10.222.0.93 () {62 vars in 1363 bytes} [Thu Jul 14 14:40:35 2022] POST /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd/os-volume_attachments => generated 188 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:40:36.877552 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-73bb651e-e4d7-4190-b3cc-cf393a16fb0b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:36.878074 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-73bb651e-e4d7-4190-b3cc-cf393a16fb0b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:36.884729 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-73bb651e-e4d7-4190-b3cc-cf393a16fb0b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:36.886053 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-73bb651e-e4d7-4190-b3cc-cf393a16fb0b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:36.886053 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-73bb651e-e4d7-4190-b3cc-cf393a16fb0b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:36.886480 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-73bb651e-e4d7-4190-b3cc-cf393a16fb0b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:37.597435 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-73bb651e-e4d7-4190-b3cc-cf393a16fb0b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd/os-volume_attachments/927a350f-b7c5-4bbf-9413-1fb36de22199" status: 202 len: 0 microversion: 2.20 time: 0.723843 Jul 14 14:40:37.598075 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 448/905] 10.222.0.93 () {60 vars in 1456 bytes} [Thu Jul 14 14:40:36 2022] DELETE /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd/os-volume_attachments/927a350f-b7c5-4bbf-9413-1fb36de22199 => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:40:37.659077 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-04fee2c9-ce35-490b-b74c-2a53a6fb5429 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:37.659693 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-04fee2c9-ce35-490b-b74c-2a53a6fb5429 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:37.667652 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-04fee2c9-ce35-490b-b74c-2a53a6fb5429 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:37.668087 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-04fee2c9-ce35-490b-b74c-2a53a6fb5429 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:37.668839 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-04fee2c9-ce35-490b-b74c-2a53a6fb5429 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:37.669260 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-04fee2c9-ce35-490b-b74c-2a53a6fb5429 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:37.903748 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-04fee2c9-ce35-490b-b74c-2a53a6fb5429 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "POST /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd/action" status: 202 len: 0 microversion: 2.20 time: 0.248597 Jul 14 14:40:37.904404 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 458/906] 10.222.0.93 () {62 vars in 1318 bytes} [Thu Jul 14 14:40:37 2022] POST /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:40:37.912735 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0ddeb4b4-1d5e-4ee8-a7ab-53c6798b5855 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:37.913534 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0ddeb4b4-1d5e-4ee8-a7ab-53c6798b5855 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:37.924265 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ddeb4b4-1d5e-4ee8-a7ab-53c6798b5855 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:37.925055 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ddeb4b4-1d5e-4ee8-a7ab-53c6798b5855 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:37.926452 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ddeb4b4-1d5e-4ee8-a7ab-53c6798b5855 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:37.927321 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0ddeb4b4-1d5e-4ee8-a7ab-53c6798b5855 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:38.063888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-0ddeb4b4-1d5e-4ee8-a7ab-53c6798b5855 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:38.071903 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-0ddeb4b4-1d5e-4ee8-a7ab-53c6798b5855 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:38.073418 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-0ddeb4b4-1d5e-4ee8-a7ab-53c6798b5855 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:38.074597 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0ddeb4b4-1d5e-4ee8-a7ab-53c6798b5855 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1673 microversion: 2.20 time: 0.166036 Jul 14 14:40:38.075155 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 449/907] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:37 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:39.094831 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-19d82540-14fa-445d-972a-9c207e2d0741 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:39.095441 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-19d82540-14fa-445d-972a-9c207e2d0741 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:39.097267 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=34 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:39.102538 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-19d82540-14fa-445d-972a-9c207e2d0741 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:39.103181 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-19d82540-14fa-445d-972a-9c207e2d0741 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:39.107983 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-19d82540-14fa-445d-972a-9c207e2d0741 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:39.107983 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-19d82540-14fa-445d-972a-9c207e2d0741 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:39.238556 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-19d82540-14fa-445d-972a-9c207e2d0741 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:39.247114 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-19d82540-14fa-445d-972a-9c207e2d0741 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:39.248710 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-19d82540-14fa-445d-972a-9c207e2d0741 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:39.249961 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-19d82540-14fa-445d-972a-9c207e2d0741 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1675 microversion: 2.20 time: 0.159664 Jul 14 14:40:39.250529 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 459/908] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:39 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:40.269148 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7475269f-d65d-4121-99fa-979e70c5ca5e tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:40.269828 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-7475269f-d65d-4121-99fa-979e70c5ca5e tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:40.276536 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7475269f-d65d-4121-99fa-979e70c5ca5e tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:40.276982 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7475269f-d65d-4121-99fa-979e70c5ca5e tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:40.277754 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7475269f-d65d-4121-99fa-979e70c5ca5e tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:40.278215 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7475269f-d65d-4121-99fa-979e70c5ca5e tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:40.652687 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7475269f-d65d-4121-99fa-979e70c5ca5e tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:40.660463 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7475269f-d65d-4121-99fa-979e70c5ca5e tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:40.662127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7475269f-d65d-4121-99fa-979e70c5ca5e tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:40.663290 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-7475269f-d65d-4121-99fa-979e70c5ca5e tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1731 microversion: 2.20 time: 0.398067 Jul 14 14:40:40.663841 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 450/909] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:40 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1731 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:41.684351 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d7c3c1f6-355e-4f76-8c17-9c79ee175202 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:41.685392 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d7c3c1f6-355e-4f76-8c17-9c79ee175202 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:41.696435 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d7c3c1f6-355e-4f76-8c17-9c79ee175202 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:41.697187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d7c3c1f6-355e-4f76-8c17-9c79ee175202 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:41.698561 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d7c3c1f6-355e-4f76-8c17-9c79ee175202 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:41.699228 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d7c3c1f6-355e-4f76-8c17-9c79ee175202 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:41.946563 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d7c3c1f6-355e-4f76-8c17-9c79ee175202 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:41.956521 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d7c3c1f6-355e-4f76-8c17-9c79ee175202 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:41.960530 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d7c3c1f6-355e-4f76-8c17-9c79ee175202 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:41.962264 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d7c3c1f6-355e-4f76-8c17-9c79ee175202 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1731 microversion: 2.20 time: 0.284573 Jul 14 14:40:41.963463 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 460/910] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:41 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1731 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:40:42.983231 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-5c63493e-c66c-4abb-b63f-c0f7021f4241 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:42.984663 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-5c63493e-c66c-4abb-b63f-c0f7021f4241 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:42.992270 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5c63493e-c66c-4abb-b63f-c0f7021f4241 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:42.993117 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5c63493e-c66c-4abb-b63f-c0f7021f4241 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:42.994190 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5c63493e-c66c-4abb-b63f-c0f7021f4241 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:42.994695 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5c63493e-c66c-4abb-b63f-c0f7021f4241 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:43.148768 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-5c63493e-c66c-4abb-b63f-c0f7021f4241 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:43.157606 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-5c63493e-c66c-4abb-b63f-c0f7021f4241 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:43.159469 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-5c63493e-c66c-4abb-b63f-c0f7021f4241 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:43.160813 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-5c63493e-c66c-4abb-b63f-c0f7021f4241 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1731 microversion: 2.20 time: 0.181505 Jul 14 14:40:43.162464 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 451/911] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:42 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:44.180117 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-04b110a3-c782-47f6-b3cd-65d6004c6ca1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:44.181330 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-04b110a3-c782-47f6-b3cd-65d6004c6ca1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:44.187514 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-04b110a3-c782-47f6-b3cd-65d6004c6ca1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:44.187952 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-04b110a3-c782-47f6-b3cd-65d6004c6ca1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:44.188725 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-04b110a3-c782-47f6-b3cd-65d6004c6ca1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:44.189157 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-04b110a3-c782-47f6-b3cd-65d6004c6ca1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:44.333604 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-04b110a3-c782-47f6-b3cd-65d6004c6ca1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:44.341498 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-04b110a3-c782-47f6-b3cd-65d6004c6ca1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:44.343060 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-04b110a3-c782-47f6-b3cd-65d6004c6ca1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:44.344219 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-04b110a3-c782-47f6-b3cd-65d6004c6ca1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1731 microversion: 2.20 time: 0.168207 Jul 14 14:40:44.344763 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 461/912] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:44 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:45.363548 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b1804439-f0f8-42f1-9836-619c6b3beb1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:45.364161 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b1804439-f0f8-42f1-9836-619c6b3beb1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:45.371651 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b1804439-f0f8-42f1-9836-619c6b3beb1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:45.375084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b1804439-f0f8-42f1-9836-619c6b3beb1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:45.375084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b1804439-f0f8-42f1-9836-619c6b3beb1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:45.375084 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b1804439-f0f8-42f1-9836-619c6b3beb1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:45.516835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b1804439-f0f8-42f1-9836-619c6b3beb1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:45.525477 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b1804439-f0f8-42f1-9836-619c6b3beb1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:45.527059 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b1804439-f0f8-42f1-9836-619c6b3beb1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:45.528219 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b1804439-f0f8-42f1-9836-619c6b3beb1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1731 microversion: 2.20 time: 0.168621 Jul 14 14:40:45.529111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 452/913] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:45 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:46.547431 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-3b3dc8b8-b620-4d89-8c44-e7e540711bd0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:46.548030 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-3b3dc8b8-b620-4d89-8c44-e7e540711bd0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:46.555438 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b3dc8b8-b620-4d89-8c44-e7e540711bd0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:46.555888 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b3dc8b8-b620-4d89-8c44-e7e540711bd0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:46.556654 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b3dc8b8-b620-4d89-8c44-e7e540711bd0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:46.557079 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b3dc8b8-b620-4d89-8c44-e7e540711bd0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:46.697278 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3b3dc8b8-b620-4d89-8c44-e7e540711bd0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:46.706134 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3b3dc8b8-b620-4d89-8c44-e7e540711bd0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:46.707657 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3b3dc8b8-b620-4d89-8c44-e7e540711bd0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:46.708890 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-3b3dc8b8-b620-4d89-8c44-e7e540711bd0 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1731 microversion: 2.20 time: 0.165540 Jul 14 14:40:46.709653 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 462/914] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:46 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:47.729522 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-1bdf1d97-002d-4bed-b9ec-c2b95cb0b497 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:47.730414 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-1bdf1d97-002d-4bed-b9ec-c2b95cb0b497 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:47.737667 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1bdf1d97-002d-4bed-b9ec-c2b95cb0b497 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:47.738257 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1bdf1d97-002d-4bed-b9ec-c2b95cb0b497 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:47.739055 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1bdf1d97-002d-4bed-b9ec-c2b95cb0b497 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:47.739481 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1bdf1d97-002d-4bed-b9ec-c2b95cb0b497 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:47.898527 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-1bdf1d97-002d-4bed-b9ec-c2b95cb0b497 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:47.906549 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-1bdf1d97-002d-4bed-b9ec-c2b95cb0b497 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:47.908040 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-1bdf1d97-002d-4bed-b9ec-c2b95cb0b497 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:47.909213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-1bdf1d97-002d-4bed-b9ec-c2b95cb0b497 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1731 microversion: 2.20 time: 0.184160 Jul 14 14:40:47.910064 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 453/915] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:47 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:40:48.927496 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-31783853-1771-496f-8d91-e06a6887d511 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:48.928094 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-31783853-1771-496f-8d91-e06a6887d511 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:48.934727 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-31783853-1771-496f-8d91-e06a6887d511 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:48.935172 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-31783853-1771-496f-8d91-e06a6887d511 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:48.935932 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-31783853-1771-496f-8d91-e06a6887d511 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:48.936362 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-31783853-1771-496f-8d91-e06a6887d511 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:49.094182 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-31783853-1771-496f-8d91-e06a6887d511 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:49.106921 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-31783853-1771-496f-8d91-e06a6887d511 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:49.109183 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-31783853-1771-496f-8d91-e06a6887d511 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:49.110429 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-31783853-1771-496f-8d91-e06a6887d511 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1731 microversion: 2.20 time: 0.187065 Jul 14 14:40:49.111104 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 463/916] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:48 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:50.128658 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-76ed728b-536d-49c1-83c5-e4f7492e6568 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:50.129351 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-76ed728b-536d-49c1-83c5-e4f7492e6568 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:50.135957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-76ed728b-536d-49c1-83c5-e4f7492e6568 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:50.136407 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-76ed728b-536d-49c1-83c5-e4f7492e6568 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:50.137164 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-76ed728b-536d-49c1-83c5-e4f7492e6568 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:50.137598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-76ed728b-536d-49c1-83c5-e4f7492e6568 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:50.267305 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-76ed728b-536d-49c1-83c5-e4f7492e6568 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:50.276363 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-76ed728b-536d-49c1-83c5-e4f7492e6568 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:50.277908 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-76ed728b-536d-49c1-83c5-e4f7492e6568 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:50.279055 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-76ed728b-536d-49c1-83c5-e4f7492e6568 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1731 microversion: 2.20 time: 0.154409 Jul 14 14:40:50.279620 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 454/917] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:50 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:40:51.297626 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a17f7724-33c8-42e9-8d2c-12d1f0aca8be tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:51.298243 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a17f7724-33c8-42e9-8d2c-12d1f0aca8be tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:51.305149 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a17f7724-33c8-42e9-8d2c-12d1f0aca8be tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:51.305591 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a17f7724-33c8-42e9-8d2c-12d1f0aca8be tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:51.306379 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a17f7724-33c8-42e9-8d2c-12d1f0aca8be tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:51.306808 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a17f7724-33c8-42e9-8d2c-12d1f0aca8be tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:51.437950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a17f7724-33c8-42e9-8d2c-12d1f0aca8be tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:51.445725 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a17f7724-33c8-42e9-8d2c-12d1f0aca8be tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:51.447343 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a17f7724-33c8-42e9-8d2c-12d1f0aca8be tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:51.448472 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a17f7724-33c8-42e9-8d2c-12d1f0aca8be tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1731 microversion: 2.20 time: 0.154785 Jul 14 14:40:51.449012 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 464/918] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:51 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:51.630351 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0a78f55e-1d33-4b4e-a6ed-25165300350e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd25d583-9e87-4931-ac27-da5b25a63b98"}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:51.631462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0a78f55e-1d33-4b4e-a6ed-25165300350e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:51.637948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0a78f55e-1d33-4b4e-a6ed-25165300350e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:51.638432 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0a78f55e-1d33-4b4e-a6ed-25165300350e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:51.639201 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0a78f55e-1d33-4b4e-a6ed-25165300350e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:51.639623 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0a78f55e-1d33-4b4e-a6ed-25165300350e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:51.730680 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-0a78f55e-1d33-4b4e-a6ed-25165300350e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] HTTP exception thrown: Invalid volume: volume dd25d583-9e87-4931-ac27-da5b25a63b98 is already attached to instances: 33dbec70-312c-4147-ac5f-5b74f2cfe64a Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0a78f55e-1d33-4b4e-a6ed-25165300350e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Request method failure captured: Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: POST /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a/os-volume_attachments HTTP/1.1 Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 74 Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0Coo2gQogloRyym-Nd5AKwohPbpaRVZzos2SNok6dsmiCUJQmaykmjw3JyCJGMIH4FxV3wh3mUDSl5SZMVXqBFX7Lk4CWppNzlNQJtOMoX0ubLPJKvnCDDOBuNYnggBOJcheNqaeVxGGln05C89djgP50UkOcd_oy4_GhZ5i307EiWw Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:40:51.732382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:40:51.734148 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:40:51.734148 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:40:51.734148 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:40:51.734148 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:40:51.734148 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:40:51.734148 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:40:51.734148 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:40:51.734148 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 98f00ffeef484dd489ed67b96d1ed783 Jul 14 14:40:51.734148 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:40:51.734148 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Jul 14 14:40:51.734148 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {"volumeAttachment": {"volumeId": "dd25d583-9e87-4931-ac27-da5b25a63b98"}} Jul 14 14:40:51.734148 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:40:51.735085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Invalid volume: volume dd25d583-9e87-4931-ac27-da5b25a63b98 is already attached to instances: 33dbec70-312c-4147-ac5f-5b74f2cfe64a Jul 14 14:40:51.735085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'server_id': '33dbec70-312c-4147-ac5f-5b74f2cfe64a', 'body': {'volumeAttachment': {'volumeId': 'dd25d583-9e87-4931-ac27-da5b25a63b98'}}} Jul 14 14:40:51.735085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:51.735085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:51.735085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 14:40:51.735085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 14:40:51.735085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:40:51.735085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:40:51.735085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 14:40:51.735085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:40:51.735085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 14:40:51.735085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 14:40:51.735085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 14:40:51.735085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 14:40:51.735085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dd25d583-9e87-4931-ac27-da5b25a63b98 is already attached to instances: 33dbec70-312c-4147-ac5f-5b74f2cfe64a Jul 14 14:40:51.735085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:40:51.735085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:51.735085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:40:51.735085 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dd25d583-9e87-4931-ac27-da5b25a63b98 is already attached to instances: 33dbec70-312c-4147-ac5f-5b74f2cfe64a Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:51.736575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:51.738728 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:51.738728 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:51.738728 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:51.738728 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dd25d583-9e87-4931-ac27-da5b25a63b98 is already attached to instances: 33dbec70-312c-4147-ac5f-5b74f2cfe64a Jul 14 14:40:51.738728 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:40:51.738728 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0a78f55e-1d33-4b4e-a6ed-25165300350e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Returning 400 to user: Invalid volume: volume dd25d583-9e87-4931-ac27-da5b25a63b98 is already attached to instances: 33dbec70-312c-4147-ac5f-5b74f2cfe64a {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:51.738728 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0a78f55e-1d33-4b4e-a6ed-25165300350e tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "POST /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107603 Jul 14 14:40:51.738728 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 455/919] 10.222.0.93 () {60 vars in 1322 bytes} [Thu Jul 14 14:40:51 2022] POST /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:40:51.796579 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-57c27111-e35e-4b08-9aa3-2a36bdaf036d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:51.797075 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-57c27111-e35e-4b08-9aa3-2a36bdaf036d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:51.803109 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-57c27111-e35e-4b08-9aa3-2a36bdaf036d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:51.803556 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-57c27111-e35e-4b08-9aa3-2a36bdaf036d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:51.804308 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-57c27111-e35e-4b08-9aa3-2a36bdaf036d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:51.804741 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-57c27111-e35e-4b08-9aa3-2a36bdaf036d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:51.884933 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.objects.instance [None req-57c27111-e35e-4b08-9aa3-2a36bdaf036d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lazy-loading 'services' on Instance uuid 33dbec70-312c-4147-ac5f-5b74f2cfe64a {{(pid=118461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:40:52.102556 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-57c27111-e35e-4b08-9aa3-2a36bdaf036d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "DELETE /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a/os-volume_attachments/dd25d583-9e87-4931-ac27-da5b25a63b98" status: 202 len: 0 microversion: 2.1 time: 0.309492 Jul 14 14:40:52.103298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 465/920] 10.222.0.93 () {58 vars in 1415 bytes} [Thu Jul 14 14:40:51 2022] DELETE /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a/os-volume_attachments/dd25d583-9e87-4931-ac27-da5b25a63b98 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:40:52.112055 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-14f1cc28-d06d-4ecd-a5ef-e2e3093a3741 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:52.113045 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-14f1cc28-d06d-4ecd-a5ef-e2e3093a3741 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:52.119560 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-14f1cc28-d06d-4ecd-a5ef-e2e3093a3741 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:52.120009 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-14f1cc28-d06d-4ecd-a5ef-e2e3093a3741 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:52.120794 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-14f1cc28-d06d-4ecd-a5ef-e2e3093a3741 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:52.121227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-14f1cc28-d06d-4ecd-a5ef-e2e3093a3741 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:52.160908 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-14f1cc28-d06d-4ecd-a5ef-e2e3093a3741 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052781 Jul 14 14:40:52.164848 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 456/921] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:40:52 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:52.467625 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-3da41b26-e7e7-40f6-9a33-439168ecc8a6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:52.468317 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-3da41b26-e7e7-40f6-9a33-439168ecc8a6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:52.475545 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3da41b26-e7e7-40f6-9a33-439168ecc8a6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:52.476004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3da41b26-e7e7-40f6-9a33-439168ecc8a6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:52.476741 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3da41b26-e7e7-40f6-9a33-439168ecc8a6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:52.477171 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3da41b26-e7e7-40f6-9a33-439168ecc8a6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:52.612864 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3da41b26-e7e7-40f6-9a33-439168ecc8a6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:52.620723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3da41b26-e7e7-40f6-9a33-439168ecc8a6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:52.622247 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3da41b26-e7e7-40f6-9a33-439168ecc8a6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:52.626382 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-3da41b26-e7e7-40f6-9a33-439168ecc8a6 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1731 microversion: 2.20 time: 0.160872 Jul 14 14:40:52.626382 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 466/922] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:52 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:53.172594 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-21735071-2414-4692-ad99-f513b24db1ea tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:53.173502 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-21735071-2414-4692-ad99-f513b24db1ea tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:53.180520 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-21735071-2414-4692-ad99-f513b24db1ea tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:53.180874 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-21735071-2414-4692-ad99-f513b24db1ea tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:53.181608 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-21735071-2414-4692-ad99-f513b24db1ea tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:53.182148 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-21735071-2414-4692-ad99-f513b24db1ea tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:53.215303 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-21735071-2414-4692-ad99-f513b24db1ea tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046558 Jul 14 14:40:53.215873 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 457/923] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:40:53 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:53.518226 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 14:40:53.537488 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Thu Jul 14 14:40:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 14:40:53.641843 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-11b426a6-67a3-431c-817f-4017186d1c02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:53.642581 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-11b426a6-67a3-431c-817f-4017186d1c02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:53.650099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-11b426a6-67a3-431c-817f-4017186d1c02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:53.650546 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-11b426a6-67a3-431c-817f-4017186d1c02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:53.651356 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-11b426a6-67a3-431c-817f-4017186d1c02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:53.651853 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-11b426a6-67a3-431c-817f-4017186d1c02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:53.796841 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-11b426a6-67a3-431c-817f-4017186d1c02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:53.808043 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-11b426a6-67a3-431c-817f-4017186d1c02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:53.811277 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-11b426a6-67a3-431c-817f-4017186d1c02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:53.812663 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-11b426a6-67a3-431c-817f-4017186d1c02 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1731 microversion: 2.20 time: 0.174753 Jul 14 14:40:53.813219 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 467/924] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:53 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:54.228694 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-8044ec4a-5815-4726-8c4d-39edb3e6d523 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:54.230306 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-8044ec4a-5815-4726-8c4d-39edb3e6d523 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:54.238192 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8044ec4a-5815-4726-8c4d-39edb3e6d523 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:54.238644 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8044ec4a-5815-4726-8c4d-39edb3e6d523 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.239421 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8044ec4a-5815-4726-8c4d-39edb3e6d523 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:54.239860 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-8044ec4a-5815-4726-8c4d-39edb3e6d523 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.251498 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-86f9534c-2661-44ab-850b-5290c366fdf0 req-8f92780d-499a-4b21-8f60-b9bbede09b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bad9638-c252-4901-8de1-beeaf6a59bbd", "name": "network-vif-plugged", "status": "completed", "tag": "ee6ee1a4-93da-4c93-9496-0e46449759f1"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:54.262776 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-86f9534c-2661-44ab-850b-5290c366fdf0 req-8f92780d-499a-4b21-8f60-b9bbede09b94 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:54.263372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-86f9534c-2661-44ab-850b-5290c366fdf0 req-8f92780d-499a-4b21-8f60-b9bbede09b94 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.271022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-8044ec4a-5815-4726-8c4d-39edb3e6d523 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048143 Jul 14 14:40:54.271597 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 458/925] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:40:54 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 14:40:54.278908 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-86f9534c-2661-44ab-850b-5290c366fdf0 req-8f92780d-499a-4b21-8f60-b9bbede09b94 service nova] Creating event network-vif-plugged:ee6ee1a4-93da-4c93-9496-0e46449759f1 for instance 8bad9638-c252-4901-8de1-beeaf6a59bbd on hv-cinder-79987 Jul 14 14:40:54.284619 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-86f9534c-2661-44ab-850b-5290c366fdf0 req-8f92780d-499a-4b21-8f60-b9bbede09b94 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038347 Jul 14 14:40:54.285552 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 468/926] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:54.335341 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ece4dd7c-b640-4ec5-9fad-3d67dbe68de7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:54.335828 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ece4dd7c-b640-4ec5-9fad-3d67dbe68de7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:54.342384 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ece4dd7c-b640-4ec5-9fad-3d67dbe68de7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:54.343187 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ece4dd7c-b640-4ec5-9fad-3d67dbe68de7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.343925 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ece4dd7c-b640-4ec5-9fad-3d67dbe68de7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:54.344469 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ece4dd7c-b640-4ec5-9fad-3d67dbe68de7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.351290 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:54.371477 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ece4dd7c-b640-4ec5-9fad-3d67dbe68de7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Going to try to terminate instance {{(pid=118462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:40:54.826914 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ece4dd7c-b640-4ec5-9fad-3d67dbe68de7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "DELETE /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a" status: 204 len: 0 microversion: 2.1 time: 0.495740 Jul 14 14:40:54.827447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 459/927] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:40:54 2022] DELETE /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:40:54.832808 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-7b4eaa83-8fad-4912-9316-a8cb04f25f9f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:54.833513 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-7b4eaa83-8fad-4912-9316-a8cb04f25f9f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:54.836977 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e19894b2-6024-42f4-b037-099935488558 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:54.837535 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e19894b2-6024-42f4-b037-099935488558 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:54.840928 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7b4eaa83-8fad-4912-9316-a8cb04f25f9f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:54.841358 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7b4eaa83-8fad-4912-9316-a8cb04f25f9f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.842200 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7b4eaa83-8fad-4912-9316-a8cb04f25f9f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:54.842634 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7b4eaa83-8fad-4912-9316-a8cb04f25f9f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.843666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e19894b2-6024-42f4-b037-099935488558 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:54.844110 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e19894b2-6024-42f4-b037-099935488558 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.844881 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e19894b2-6024-42f4-b037-099935488558 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:54.845315 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e19894b2-6024-42f4-b037-099935488558 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.846888 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:55.036257 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7b4eaa83-8fad-4912-9316-a8cb04f25f9f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:55.040734 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e19894b2-6024-42f4-b037-099935488558 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:55.045002 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7b4eaa83-8fad-4912-9316-a8cb04f25f9f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:55.046594 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7b4eaa83-8fad-4912-9316-a8cb04f25f9f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:55.047774 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-7b4eaa83-8fad-4912-9316-a8cb04f25f9f tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1731 microversion: 2.20 time: 0.220690 Jul 14 14:40:55.048320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e19894b2-6024-42f4-b037-099935488558 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a" status: 200 len: 1682 microversion: 2.1 time: 0.216147 Jul 14 14:40:55.048428 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 469/928] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:54 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:40:55.048880 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 460/929] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:54 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:56.066491 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f2dfb0cb-006c-426d-93b2-ac62a22fd331 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:56.067059 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-451fe478-732f-42ac-8206-635a06f913c9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:56.067420 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f2dfb0cb-006c-426d-93b2-ac62a22fd331 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:56.067611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-451fe478-732f-42ac-8206-635a06f913c9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:56.073726 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f2dfb0cb-006c-426d-93b2-ac62a22fd331 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:56.074196 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f2dfb0cb-006c-426d-93b2-ac62a22fd331 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:56.074302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-451fe478-732f-42ac-8206-635a06f913c9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:56.074686 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-451fe478-732f-42ac-8206-635a06f913c9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:56.074960 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f2dfb0cb-006c-426d-93b2-ac62a22fd331 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:56.075393 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f2dfb0cb-006c-426d-93b2-ac62a22fd331 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:56.075521 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-451fe478-732f-42ac-8206-635a06f913c9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:56.075871 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-451fe478-732f-42ac-8206-635a06f913c9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:56.276212 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-451fe478-732f-42ac-8206-635a06f913c9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:56.280421 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f2dfb0cb-006c-426d-93b2-ac62a22fd331 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:56.284021 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-451fe478-732f-42ac-8206-635a06f913c9 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a" status: 200 len: 1682 microversion: 2.1 time: 0.221859 Jul 14 14:40:56.284595 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 470/930] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:56 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a => generated 1682 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:56.289180 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f2dfb0cb-006c-426d-93b2-ac62a22fd331 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:56.290739 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f2dfb0cb-006c-426d-93b2-ac62a22fd331 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:56.291908 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f2dfb0cb-006c-426d-93b2-ac62a22fd331 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1731 microversion: 2.20 time: 0.229732 Jul 14 14:40:56.292447 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 461/931] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:56 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1731 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:40:57.302432 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-fbbbe163-f65a-447b-93da-c0510455ace7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:57.303237 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-fbbbe163-f65a-447b-93da-c0510455ace7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:57.310530 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-2abdaeaa-5e85-4a2f-b97b-3821378ba6fe tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:57.311274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-2abdaeaa-5e85-4a2f-b97b-3821378ba6fe tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:57.311519 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fbbbe163-f65a-447b-93da-c0510455ace7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:57.311995 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fbbbe163-f65a-447b-93da-c0510455ace7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:57.313117 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fbbbe163-f65a-447b-93da-c0510455ace7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:57.313117 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fbbbe163-f65a-447b-93da-c0510455ace7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:57.331465 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2abdaeaa-5e85-4a2f-b97b-3821378ba6fe tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:57.331465 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2abdaeaa-5e85-4a2f-b97b-3821378ba6fe tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:57.331465 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2abdaeaa-5e85-4a2f-b97b-3821378ba6fe tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:57.331465 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2abdaeaa-5e85-4a2f-b97b-3821378ba6fe tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:57.406275 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-fbbbe163-f65a-447b-93da-c0510455ace7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:57.414178 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-fbbbe163-f65a-447b-93da-c0510455ace7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a" status: 200 len: 1614 microversion: 2.1 time: 0.116544 Jul 14 14:40:57.415679 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 471/932] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:57 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a => generated 1614 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:57.490835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-2abdaeaa-5e85-4a2f-b97b-3821378ba6fe tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:57.499204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-2abdaeaa-5e85-4a2f-b97b-3821378ba6fe tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:57.500706 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-2abdaeaa-5e85-4a2f-b97b-3821378ba6fe tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:57.502048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-2abdaeaa-5e85-4a2f-b97b-3821378ba6fe tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1731 microversion: 2.20 time: 0.195989 Jul 14 14:40:57.502606 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 462/933] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:57 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:40:57.620732 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-1d2b1d7a-af23-41a8-b067-34d3860b67e1 req-1aaf493a-eb44-451e-beee-d0e3bfdc8b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33dbec70-312c-4147-ac5f-5b74f2cfe64a", "name": "network-vif-deleted", "tag": "7623ee61-4803-456e-964e-d8c752c8b1cf"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:57.629664 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-1d2b1d7a-af23-41a8-b067-34d3860b67e1 req-1aaf493a-eb44-451e-beee-d0e3bfdc8b51 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:57.630150 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-1d2b1d7a-af23-41a8-b067-34d3860b67e1 req-1aaf493a-eb44-451e-beee-d0e3bfdc8b51 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:57.641881 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-1d2b1d7a-af23-41a8-b067-34d3860b67e1 req-1aaf493a-eb44-451e-beee-d0e3bfdc8b51 service nova] Creating event network-vif-deleted:7623ee61-4803-456e-964e-d8c752c8b1cf for instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a on hv-cinder-79987 Jul 14 14:40:57.647593 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-1d2b1d7a-af23-41a8-b067-34d3860b67e1 req-1aaf493a-eb44-451e-beee-d0e3bfdc8b51 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030779 Jul 14 14:40:57.648484 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 472/934] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:58.434226 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-98c65eff-8fa2-4756-b722-e0bc022420f4 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:58.435021 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-98c65eff-8fa2-4756-b722-e0bc022420f4 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:58.460983 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-98c65eff-8fa2-4756-b722-e0bc022420f4 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:58.460983 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-98c65eff-8fa2-4756-b722-e0bc022420f4 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:58.460983 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-98c65eff-8fa2-4756-b722-e0bc022420f4 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:58.460983 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-98c65eff-8fa2-4756-b722-e0bc022420f4 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:58.490938 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-98c65eff-8fa2-4756-b722-e0bc022420f4 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:58.491379 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-98c65eff-8fa2-4756-b722-e0bc022420f4 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:58.491863 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-98c65eff-8fa2-4756-b722-e0bc022420f4 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lazy-loading 'fault' on Instance uuid 33dbec70-312c-4147-ac5f-5b74f2cfe64a {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:40:58.522531 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-75b81dc9-1e99-4c5e-ae1a-e4cb674e561b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:58.523250 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-75b81dc9-1e99-4c5e-ae1a-e4cb674e561b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:58.536140 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-75b81dc9-1e99-4c5e-ae1a-e4cb674e561b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:58.536140 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-75b81dc9-1e99-4c5e-ae1a-e4cb674e561b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:58.536140 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-75b81dc9-1e99-4c5e-ae1a-e4cb674e561b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:58.536140 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-75b81dc9-1e99-4c5e-ae1a-e4cb674e561b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:58.543182 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-98c65eff-8fa2-4756-b722-e0bc022420f4 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:58.551034 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-98c65eff-8fa2-4756-b722-e0bc022420f4 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a" status: 200 len: 1331 microversion: 2.1 time: 0.122643 Jul 14 14:40:58.551699 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 463/935] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:58 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a => generated 1331 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:58.679004 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-75b81dc9-1e99-4c5e-ae1a-e4cb674e561b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:58.687477 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-75b81dc9-1e99-4c5e-ae1a-e4cb674e561b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:58.692910 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-75b81dc9-1e99-4c5e-ae1a-e4cb674e561b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:58.692910 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-75b81dc9-1e99-4c5e-ae1a-e4cb674e561b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1731 microversion: 2.20 time: 0.173110 Jul 14 14:40:58.692910 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 473/936] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:58 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:40:59.568529 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a2882a08-0fc9-4e8b-8af8-7511f10d68f1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:59.569141 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a2882a08-0fc9-4e8b-8af8-7511f10d68f1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:59.575799 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a2882a08-0fc9-4e8b-8af8-7511f10d68f1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:59.576245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a2882a08-0fc9-4e8b-8af8-7511f10d68f1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:59.577090 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a2882a08-0fc9-4e8b-8af8-7511f10d68f1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:59.577530 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a2882a08-0fc9-4e8b-8af8-7511f10d68f1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:59.591204 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-a2882a08-0fc9-4e8b-8af8-7511f10d68f1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] HTTP exception thrown: Instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a could not be found. Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a2882a08-0fc9-4e8b-8af8-7511f10d68f1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Request method failure captured: Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a HTTP/1.1 Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0Coo2gQogloRyym-Nd5AKwohPbpaRVZzos2SNok6dsmiCUJQmaykmjw3JyCJGMIH4FxV3wh3mUDSl5SZMVXqBFX7Lk4CWppNzlNQJtOMoX0ubLPJKvnCDDOBuNYnggBOJcheNqaeVxGGln05C89djgP50UkOcd_oy4_GhZ5i307EiWw Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:40:59.592835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:40:59.594462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:40:59.594462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:40:59.594462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:40:59.594462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:40:59.594462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:40:59.594462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:40:59.594462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:40:59.594462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 98f00ffeef484dd489ed67b96d1ed783 Jul 14 14:40:59.594462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:40:59.594462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:40:59.594462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a could not be found. Jul 14 14:40:59.594462 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '33dbec70-312c-4147-ac5f-5b74f2cfe64a'} Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a could not be found. Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:59.595370 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:59.596876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:59.596876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:40:59.596876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:40:59.596876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:40:59.596876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:40:59.596876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:40:59.596876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:40:59.596876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a could not be found. Jul 14 14:40:59.596876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:40:59.596876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:59.596876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:40:59.596876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:59.596876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:59.596876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:59.596876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:59.596876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:59.596876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a could not be found. Jul 14 14:40:59.596876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:40:59.599188 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a2882a08-0fc9-4e8b-8af8-7511f10d68f1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Returning 404 to user: Instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:59.599188 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a2882a08-0fc9-4e8b-8af8-7511f10d68f1 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a" status: 404 len: 111 microversion: 2.1 time: 0.029853 Jul 14 14:40:59.599188 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 464/937] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:59 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:40:59.603829 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-7a6f4ac7-841e-4b8d-bf17-b4b90e8caf36 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '.version_select at 0x7f415ff6da60>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:59.701288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-7a6f4ac7-841e-4b8d-bf17-b4b90e8caf36 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1293023964" status: 202 len: 0 microversion: 2.1 time: 0.101059 Jul 14 14:40:59.701817 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 474/938] 10.222.0.93 () {58 vars in 1220 bytes} [Thu Jul 14 14:40:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1293023964 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:40:59.709167 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-fa214e32-482f-46c1-93a1-71649c7bdf1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:59.709826 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-fa214e32-482f-46c1-93a1-71649c7bdf1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:59.716020 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fa214e32-482f-46c1-93a1-71649c7bdf1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:59.716506 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fa214e32-482f-46c1-93a1-71649c7bdf1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:59.717329 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fa214e32-482f-46c1-93a1-71649c7bdf1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:59.717785 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fa214e32-482f-46c1-93a1-71649c7bdf1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:59.845998 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-fa214e32-482f-46c1-93a1-71649c7bdf1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:59.854739 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-fa214e32-482f-46c1-93a1-71649c7bdf1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:59.856253 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-fa214e32-482f-46c1-93a1-71649c7bdf1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:59.857408 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-fa214e32-482f-46c1-93a1-71649c7bdf1b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1718 microversion: 2.20 time: 0.152799 Jul 14 14:40:59.858015 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 465/939] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:59 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:00.783387 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ca6cf8d7-274d-4599-80f9-1291b800f90f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Action: 'create', calling method: .version_select at 0x7f415fdacf70>, body: {"keypair": {"name": "tempest-keypair-385195187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBt57mpmbHudJ1MrNjttAn24bSV4HRkEaohy1QQaWiGv/Wdab4c/6gtl8xBEyNIDjjnAVBN6BCTN0ksDhf2lGSHcxlL64YAMNt3yc7t7oxabgFdptd8HTeYtMVOahc8lQw=="}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:00.797812 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-ca6cf8d7-274d-4599-80f9-1291b800f90f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Getting quotas for project abb12869989f45cc875ecb36dd1f7aef. Resources: {'key_pairs'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:41:00.802194 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-ca6cf8d7-274d-4599-80f9-1291b800f90f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Getting quotas for user 98f00ffeef484dd489ed67b96d1ed783 and project abb12869989f45cc875ecb36dd1f7aef. Resources: {'key_pairs'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:41:00.970143 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-ca6cf8d7-274d-4599-80f9-1291b800f90f tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.191183 Jul 14 14:41:00.970704 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 475/940] 10.222.0.93 () {60 vars in 1158 bytes} [Thu Jul 14 14:41:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:04.165522 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-9d4185c8-9667-41d0-a590-191ceaa4fa35 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-815315043", "imageRef": "7ea875a4-facb-4053-be2d-ff0080d2f3a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e31486e8-2bc1-4f00-b9ce-bbd86c605e0f"}], "security_groups": [{"name": "tempest-securitygroup--783128981"}], "key_name": "tempest-keypair-385195187", "user_data": "}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:04.268473 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.network.neutron [None req-9d4185c8-9667-41d0-a590-191ceaa4fa35 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] validate_networks() for [('e31486e8-2bc1-4f00-b9ce-bbd86c605e0f', None, None, None, None, None)] {{(pid=118462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:41:04.651579 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-9d4185c8-9667-41d0-a590-191ceaa4fa35 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Flavor limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:41:04.653961 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-9d4185c8-9667-41d0-a590-191ceaa4fa35 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Image limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:41:04.653961 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-9d4185c8-9667-41d0-a590-191ceaa4fa35 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Flavor pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:41:04.653961 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-9d4185c8-9667-41d0-a590-191ceaa4fa35 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Image pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:41:04.653961 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-9d4185c8-9667-41d0-a590-191ceaa4fa35 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:41:04.662080 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9d4185c8-9667-41d0-a590-191ceaa4fa35 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:04.662547 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9d4185c8-9667-41d0-a590-191ceaa4fa35 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:04.663327 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9d4185c8-9667-41d0-a590-191ceaa4fa35 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:04.663751 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9d4185c8-9667-41d0-a590-191ceaa4fa35 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:04.679847 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-9d4185c8-9667-41d0-a590-191ceaa4fa35 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Getting quotas for project abb12869989f45cc875ecb36dd1f7aef. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:41:04.683724 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-9d4185c8-9667-41d0-a590-191ceaa4fa35 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Getting quotas for user 98f00ffeef484dd489ed67b96d1ed783 and project abb12869989f45cc875ecb36dd1f7aef. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:41:04.695511 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-9d4185c8-9667-41d0-a590-191ceaa4fa35 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Going to run 1 instances... {{(pid=118462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:41:04.697735 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-9d4185c8-9667-41d0-a590-191ceaa4fa35 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ea875a4-facb-4053-be2d-ff0080d2f3a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:41:04.931695 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-9d4185c8-9667-41d0-a590-191ceaa4fa35 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.770376 Jul 14 14:41:04.932620 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 466/941] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:41:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:41:04.943826 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4fd54615-bb28-40b8-853b-0f2ab4a42401 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:04.946286 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-4fd54615-bb28-40b8-853b-0f2ab4a42401 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:04.997997 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-4fd54615-bb28-40b8-853b-0f2ab4a42401 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:05.005412 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4fd54615-bb28-40b8-853b-0f2ab4a42401 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca" status: 200 len: 1240 microversion: 2.1 time: 0.066760 Jul 14 14:41:05.006018 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 476/942] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:04 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:06.022249 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ab77df31-1cff-4def-ad34-bb73683c96ba tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:06.028209 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ab77df31-1cff-4def-ad34-bb73683c96ba tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:06.028209 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:06.030559 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ab77df31-1cff-4def-ad34-bb73683c96ba tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:06.031002 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ab77df31-1cff-4def-ad34-bb73683c96ba tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:06.031761 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ab77df31-1cff-4def-ad34-bb73683c96ba tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:06.032196 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ab77df31-1cff-4def-ad34-bb73683c96ba tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:06.093192 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ab77df31-1cff-4def-ad34-bb73683c96ba tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:06.101545 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ab77df31-1cff-4def-ad34-bb73683c96ba tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca" status: 200 len: 1244 microversion: 2.1 time: 0.083820 Jul 14 14:41:06.102140 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 467/943] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:06 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:07.118611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-93071edd-a385-4b39-8e25-49156eae48ce tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:07.119221 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-93071edd-a385-4b39-8e25-49156eae48ce tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:07.125869 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-93071edd-a385-4b39-8e25-49156eae48ce tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:07.126325 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-93071edd-a385-4b39-8e25-49156eae48ce tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:07.127085 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-93071edd-a385-4b39-8e25-49156eae48ce tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:07.127517 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-93071edd-a385-4b39-8e25-49156eae48ce tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:07.192362 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-93071edd-a385-4b39-8e25-49156eae48ce tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:07.199906 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-93071edd-a385-4b39-8e25-49156eae48ce tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca" status: 200 len: 1292 microversion: 2.1 time: 0.085142 Jul 14 14:41:07.200495 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 477/944] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:07 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:41:08.218898 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c2b1d941-aee5-4ce6-a93e-a34d2f938037 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:08.218898 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c2b1d941-aee5-4ce6-a93e-a34d2f938037 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:08.226688 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c2b1d941-aee5-4ce6-a93e-a34d2f938037 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:08.227096 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c2b1d941-aee5-4ce6-a93e-a34d2f938037 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:08.228001 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c2b1d941-aee5-4ce6-a93e-a34d2f938037 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:08.228299 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c2b1d941-aee5-4ce6-a93e-a34d2f938037 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:08.375914 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-c2b1d941-aee5-4ce6-a93e-a34d2f938037 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:08.383988 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c2b1d941-aee5-4ce6-a93e-a34d2f938037 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca" status: 200 len: 1365 microversion: 2.1 time: 0.170678 Jul 14 14:41:08.388295 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 468/945] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:08 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:09.189538 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-d1153be2-3a07-4283-8882-532acad07e52 req-75dc7c2b-35a1-4154-81de-470c2d9becfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3662dbbd-4bda-437b-9974-53a4b0e35bca", "tag": "cd39c8a0-4ff6-4ac9-943d-0fc4cc7967cb"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:09.198790 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:09.200969 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-d1153be2-3a07-4283-8882-532acad07e52 req-75dc7c2b-35a1-4154-81de-470c2d9becfc service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:09.201406 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-d1153be2-3a07-4283-8882-532acad07e52 req-75dc7c2b-35a1-4154-81de-470c2d9becfc service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:09.214516 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-d1153be2-3a07-4283-8882-532acad07e52 req-75dc7c2b-35a1-4154-81de-470c2d9becfc service nova] Creating event network-changed:cd39c8a0-4ff6-4ac9-943d-0fc4cc7967cb for instance 3662dbbd-4bda-437b-9974-53a4b0e35bca on hv-cinder-79987 Jul 14 14:41:09.219860 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-d1153be2-3a07-4283-8882-532acad07e52 req-75dc7c2b-35a1-4154-81de-470c2d9becfc service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033978 Jul 14 14:41:09.220464 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 478/946] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:09.401844 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-95ad5ad8-238c-4c8c-b631-99b568aad6ff tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:09.402394 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-95ad5ad8-238c-4c8c-b631-99b568aad6ff tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:09.409356 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-95ad5ad8-238c-4c8c-b631-99b568aad6ff tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:09.409812 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-95ad5ad8-238c-4c8c-b631-99b568aad6ff tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:09.410571 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-95ad5ad8-238c-4c8c-b631-99b568aad6ff tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:09.410995 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-95ad5ad8-238c-4c8c-b631-99b568aad6ff tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:09.541755 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-95ad5ad8-238c-4c8c-b631-99b568aad6ff tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:09.549745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-95ad5ad8-238c-4c8c-b631-99b568aad6ff tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca" status: 200 len: 1365 microversion: 2.1 time: 0.152375 Jul 14 14:41:09.550878 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 469/947] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:09 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:10.567000 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a3aef642-0a09-4b42-8f66-c4770ca481f6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:10.567729 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a3aef642-0a09-4b42-8f66-c4770ca481f6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:10.575039 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a3aef642-0a09-4b42-8f66-c4770ca481f6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:10.575482 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a3aef642-0a09-4b42-8f66-c4770ca481f6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:10.576247 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a3aef642-0a09-4b42-8f66-c4770ca481f6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:10.576676 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a3aef642-0a09-4b42-8f66-c4770ca481f6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:10.719883 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a3aef642-0a09-4b42-8f66-c4770ca481f6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:10.728086 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a3aef642-0a09-4b42-8f66-c4770ca481f6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca" status: 200 len: 1365 microversion: 2.1 time: 0.165340 Jul 14 14:41:10.728650 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 479/948] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:10 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:11.744729 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-95adae53-1726-459e-b7b5-7f457213067b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:11.745325 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-95adae53-1726-459e-b7b5-7f457213067b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:11.751757 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-95adae53-1726-459e-b7b5-7f457213067b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:11.752195 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-95adae53-1726-459e-b7b5-7f457213067b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:11.752936 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-95adae53-1726-459e-b7b5-7f457213067b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:11.753382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-95adae53-1726-459e-b7b5-7f457213067b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:11.879751 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-95adae53-1726-459e-b7b5-7f457213067b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:11.887217 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-95adae53-1726-459e-b7b5-7f457213067b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca" status: 200 len: 1365 microversion: 2.1 time: 0.146391 Jul 14 14:41:11.887718 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 470/949] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:11 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:12.903394 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-268d9f2a-82ce-4ee8-bfd1-e7d97fe66fe5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:12.904003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-268d9f2a-82ce-4ee8-bfd1-e7d97fe66fe5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:12.910835 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-268d9f2a-82ce-4ee8-bfd1-e7d97fe66fe5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:12.911274 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-268d9f2a-82ce-4ee8-bfd1-e7d97fe66fe5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:12.912022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-268d9f2a-82ce-4ee8-bfd1-e7d97fe66fe5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:12.912448 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-268d9f2a-82ce-4ee8-bfd1-e7d97fe66fe5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:13.040956 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-268d9f2a-82ce-4ee8-bfd1-e7d97fe66fe5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:13.048361 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-268d9f2a-82ce-4ee8-bfd1-e7d97fe66fe5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca" status: 200 len: 1365 microversion: 2.1 time: 0.148857 Jul 14 14:41:13.048925 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 480/950] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:12 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:14.064995 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-2b48debd-a60a-4b7c-97f8-5d3f246508ac tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:14.066132 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-2b48debd-a60a-4b7c-97f8-5d3f246508ac tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:14.072751 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2b48debd-a60a-4b7c-97f8-5d3f246508ac tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:14.073194 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2b48debd-a60a-4b7c-97f8-5d3f246508ac tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:14.073995 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2b48debd-a60a-4b7c-97f8-5d3f246508ac tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:14.074422 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2b48debd-a60a-4b7c-97f8-5d3f246508ac tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:14.203074 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-2b48debd-a60a-4b7c-97f8-5d3f246508ac tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:14.211214 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-2b48debd-a60a-4b7c-97f8-5d3f246508ac tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca" status: 200 len: 1365 microversion: 2.1 time: 0.150145 Jul 14 14:41:14.211780 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 471/951] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:14 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:14.404229 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-d9f8512c-d90f-4497-b8d3-9922f4587ac2 req-438cbfbb-81e4-401f-b133-db21f377cbfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3662dbbd-4bda-437b-9974-53a4b0e35bca", "name": "network-vif-plugged", "status": "completed", "tag": "cd39c8a0-4ff6-4ac9-943d-0fc4cc7967cb"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:14.413242 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-d9f8512c-d90f-4497-b8d3-9922f4587ac2 req-438cbfbb-81e4-401f-b133-db21f377cbfe service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:14.413400 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-d9f8512c-d90f-4497-b8d3-9922f4587ac2 req-438cbfbb-81e4-401f-b133-db21f377cbfe service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:14.428223 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-d9f8512c-d90f-4497-b8d3-9922f4587ac2 req-438cbfbb-81e4-401f-b133-db21f377cbfe service nova] Creating event network-vif-plugged:cd39c8a0-4ff6-4ac9-943d-0fc4cc7967cb for instance 3662dbbd-4bda-437b-9974-53a4b0e35bca on hv-cinder-79987 Jul 14 14:41:14.436346 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-d9f8512c-d90f-4497-b8d3-9922f4587ac2 req-438cbfbb-81e4-401f-b133-db21f377cbfe service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035890 Jul 14 14:41:14.436959 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 481/952] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:15.227763 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-1dc57ee9-63b8-4b86-90bf-57306dff6e4d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:15.228348 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-1dc57ee9-63b8-4b86-90bf-57306dff6e4d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:15.230222 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=2 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:15.230868 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=6 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:15.237924 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1dc57ee9-63b8-4b86-90bf-57306dff6e4d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:15.238365 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1dc57ee9-63b8-4b86-90bf-57306dff6e4d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:15.239136 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1dc57ee9-63b8-4b86-90bf-57306dff6e4d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:15.239574 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1dc57ee9-63b8-4b86-90bf-57306dff6e4d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:15.377145 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-1dc57ee9-63b8-4b86-90bf-57306dff6e4d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:15.386514 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-1dc57ee9-63b8-4b86-90bf-57306dff6e4d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca" status: 200 len: 1365 microversion: 2.1 time: 0.162653 Jul 14 14:41:15.387090 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 472/953] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:15 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:16.402416 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=6 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:16.407410 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-fd68d9a6-f126-47a7-b4a6-46e007a08466 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:16.408107 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-fd68d9a6-f126-47a7-b4a6-46e007a08466 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:16.414987 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fd68d9a6-f126-47a7-b4a6-46e007a08466 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:16.415428 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fd68d9a6-f126-47a7-b4a6-46e007a08466 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:16.416193 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fd68d9a6-f126-47a7-b4a6-46e007a08466 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:16.416618 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fd68d9a6-f126-47a7-b4a6-46e007a08466 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:16.589376 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-fd68d9a6-f126-47a7-b4a6-46e007a08466 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:16.596833 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-fd68d9a6-f126-47a7-b4a6-46e007a08466 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca" status: 200 len: 1555 microversion: 2.1 time: 0.196356 Jul 14 14:41:16.597401 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 482/954] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:16 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca => generated 1555 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:16.613759 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-20543403-ece5-457a-850d-18089c178cb8 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:16.614350 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-20543403-ece5-457a-850d-18089c178cb8 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:16.620791 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-20543403-ece5-457a-850d-18089c178cb8 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:16.621243 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-20543403-ece5-457a-850d-18089c178cb8 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:16.622066 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-20543403-ece5-457a-850d-18089c178cb8 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:16.622498 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-20543403-ece5-457a-850d-18089c178cb8 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:16.699318 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-20543403-ece5-457a-850d-18089c178cb8 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089960 Jul 14 14:41:16.699906 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 473/955] 10.222.0.93 () {58 vars in 1274 bytes} [Thu Jul 14 14:41:16 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:17.728596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-87589468-0dcc-4769-bc26-f5f92e766fe5 req-fcddbf95-afaf-4f94-92a1-52c02c0719b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3662dbbd-4bda-437b-9974-53a4b0e35bca", "tag": "cd39c8a0-4ff6-4ac9-943d-0fc4cc7967cb"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:17.737365 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-87589468-0dcc-4769-bc26-f5f92e766fe5 req-fcddbf95-afaf-4f94-92a1-52c02c0719b6 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:17.737840 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-87589468-0dcc-4769-bc26-f5f92e766fe5 req-fcddbf95-afaf-4f94-92a1-52c02c0719b6 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:17.748808 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-87589468-0dcc-4769-bc26-f5f92e766fe5 req-fcddbf95-afaf-4f94-92a1-52c02c0719b6 service nova] Creating event network-changed:cd39c8a0-4ff6-4ac9-943d-0fc4cc7967cb for instance 3662dbbd-4bda-437b-9974-53a4b0e35bca on hv-cinder-79987 Jul 14 14:41:17.754222 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-87589468-0dcc-4769-bc26-f5f92e766fe5 req-fcddbf95-afaf-4f94-92a1-52c02c0719b6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029303 Jul 14 14:41:17.754816 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 483/956] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:30.631321 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=13 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:30.632099 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:30.636103 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-1aa7d344-f2a3-48c9-af58-0fe8727fa988 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:30.637095 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-1aa7d344-f2a3-48c9-af58-0fe8727fa988 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:30.642989 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1aa7d344-f2a3-48c9-af58-0fe8727fa988 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:30.643432 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1aa7d344-f2a3-48c9-af58-0fe8727fa988 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:30.644182 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1aa7d344-f2a3-48c9-af58-0fe8727fa988 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:30.644611 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1aa7d344-f2a3-48c9-af58-0fe8727fa988 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:30.673100 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-1aa7d344-f2a3-48c9-af58-0fe8727fa988 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043189 Jul 14 14:41:30.673652 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 474/957] 10.222.0.93 () {60 vars in 1342 bytes} [Thu Jul 14 14:41:30 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:30.727740 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=11 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:30.728516 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=55 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:30.732614 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b9bd62d1-8520-42dc-a0c1-ec8726c5d06c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:30.733198 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b9bd62d1-8520-42dc-a0c1-ec8726c5d06c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:30.739853 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b9bd62d1-8520-42dc-a0c1-ec8726c5d06c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:30.747702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b9bd62d1-8520-42dc-a0c1-ec8726c5d06c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:30.747702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b9bd62d1-8520-42dc-a0c1-ec8726c5d06c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:30.747702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b9bd62d1-8520-42dc-a0c1-ec8726c5d06c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:30.766202 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b9bd62d1-8520-42dc-a0c1-ec8726c5d06c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Going to try to terminate instance {{(pid=118461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:41:31.252673 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b9bd62d1-8520-42dc-a0c1-ec8726c5d06c tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 204 len: 0 microversion: 2.20 time: 0.526270 Jul 14 14:41:31.253266 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 484/958] 10.222.0.93 () {60 vars in 1279 bytes} [Thu Jul 14 14:41:30 2022] DELETE /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:41:31.261655 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-262c0459-96a4-41e3-a65f-a6245859845d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:31.262288 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-262c0459-96a4-41e3-a65f-a6245859845d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:31.268740 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-262c0459-96a4-41e3-a65f-a6245859845d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:31.269586 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-262c0459-96a4-41e3-a65f-a6245859845d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:31.270047 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-262c0459-96a4-41e3-a65f-a6245859845d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:31.270484 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-262c0459-96a4-41e3-a65f-a6245859845d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:31.399556 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-262c0459-96a4-41e3-a65f-a6245859845d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:31.407330 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-262c0459-96a4-41e3-a65f-a6245859845d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:31.409333 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-262c0459-96a4-41e3-a65f-a6245859845d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:31.410506 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-262c0459-96a4-41e3-a65f-a6245859845d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1724 microversion: 2.20 time: 0.153060 Jul 14 14:41:31.411135 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 475/959] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:31 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:32.430873 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-271ae3ab-8574-45db-bc02-c2f8b7ac71a3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:32.431481 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-271ae3ab-8574-45db-bc02-c2f8b7ac71a3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:32.437994 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-271ae3ab-8574-45db-bc02-c2f8b7ac71a3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:32.438437 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-271ae3ab-8574-45db-bc02-c2f8b7ac71a3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:32.439190 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-271ae3ab-8574-45db-bc02-c2f8b7ac71a3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:32.440204 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-271ae3ab-8574-45db-bc02-c2f8b7ac71a3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:32.581719 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-271ae3ab-8574-45db-bc02-c2f8b7ac71a3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:32.589683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-271ae3ab-8574-45db-bc02-c2f8b7ac71a3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:32.596163 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-271ae3ab-8574-45db-bc02-c2f8b7ac71a3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:32.596163 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-271ae3ab-8574-45db-bc02-c2f8b7ac71a3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1724 microversion: 2.20 time: 0.165926 Jul 14 14:41:32.596163 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 485/960] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:32 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:33.591451 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-8a0a6176-38eb-45e0-86f0-b541814dec47 req-45e216fe-d5db-44a6-9e01-fbe2661bb0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bad9638-c252-4901-8de1-beeaf6a59bbd", "name": "network-vif-deleted", "tag": "ee6ee1a4-93da-4c93-9496-0e46449759f1"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:33.605226 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-8a0a6176-38eb-45e0-86f0-b541814dec47 req-45e216fe-d5db-44a6-9e01-fbe2661bb0c1 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:33.605808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-8a0a6176-38eb-45e0-86f0-b541814dec47 req-45e216fe-d5db-44a6-9e01-fbe2661bb0c1 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:33.610912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-f0ce625f-b655-4d25-965b-ac0a6f70b46d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:33.613019 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-f0ce625f-b655-4d25-965b-ac0a6f70b46d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:33.620716 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f0ce625f-b655-4d25-965b-ac0a6f70b46d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:33.621558 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f0ce625f-b655-4d25-965b-ac0a6f70b46d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:33.622587 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f0ce625f-b655-4d25-965b-ac0a6f70b46d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:33.623229 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-f0ce625f-b655-4d25-965b-ac0a6f70b46d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:33.632659 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-8a0a6176-38eb-45e0-86f0-b541814dec47 req-45e216fe-d5db-44a6-9e01-fbe2661bb0c1 service nova] Creating event network-vif-deleted:ee6ee1a4-93da-4c93-9496-0e46449759f1 for instance 8bad9638-c252-4901-8de1-beeaf6a59bbd on hv-cinder-79987 Jul 14 14:41:33.639244 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-8a0a6176-38eb-45e0-86f0-b541814dec47 req-45e216fe-d5db-44a6-9e01-fbe2661bb0c1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116490 Jul 14 14:41:33.641805 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 476/961] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:33.696825 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-f0ce625f-b655-4d25-965b-ac0a6f70b46d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:33.707802 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-f0ce625f-b655-4d25-965b-ac0a6f70b46d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:33.709410 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-f0ce625f-b655-4d25-965b-ac0a6f70b46d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01c0469b67814077b4544cea54a0192e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7378149db04942bdbc1035f0a3a902fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:33.710773 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-f0ce625f-b655-4d25-965b-ac0a6f70b46d tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 200 len: 1656 microversion: 2.20 time: 0.103723 Jul 14 14:41:33.711419 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 486/962] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:33 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 1656 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:34.730828 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-cc011ca4-f065-4284-8fd6-c0926366a8f1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:34.731516 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-cc011ca4-f065-4284-8fd6-c0926366a8f1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:34.737996 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cc011ca4-f065-4284-8fd6-c0926366a8f1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:34.738563 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cc011ca4-f065-4284-8fd6-c0926366a8f1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:34.739324 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cc011ca4-f065-4284-8fd6-c0926366a8f1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:34.739834 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cc011ca4-f065-4284-8fd6-c0926366a8f1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:34.754803 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-cc011ca4-f065-4284-8fd6-c0926366a8f1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] HTTP exception thrown: Instance 8bad9638-c252-4901-8de1-beeaf6a59bbd could not be found. Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-cc011ca4-f065-4284-8fd6-c0926366a8f1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Request method failure captured: Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd HTTP/1.1 Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0CnoYQbKwq8kU_5wNcosEgjOYNzujHJ85UInUmEl35vtd8o6ruzgGoSGgdKatIygkH6MtNbeI4n75875r1mVgJuc4qNgBbBxb1W_52tgpHaKGyIIXOSKCrGhE6XpTSHmT0fLG9WvbjpAR9Z20B_eJdUFeRnUwWDVjYXkaVsL5oClC7Y Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: 7378149db04942bdbc1035f0a3a902fe Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-377922018 Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:41:34.756470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:41:34.766213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:41:34.766213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-AttachVolumeShelveTestJSON-377922018 Jul 14 14:41:34.766213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: 7378149db04942bdbc1035f0a3a902fe Jul 14 14:41:34.766213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-377922018 Jul 14 14:41:34.766213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-AttachVolumeShelveTestJSON-377922018-project Jul 14 14:41:34.766213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:41:34.766213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:41:34.766213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 01c0469b67814077b4544cea54a0192e Jul 14 14:41:34.766213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-AttachVolumeShelveTestJSON-377922018-project Jul 14 14:41:34.766213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:41:34.766213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 8bad9638-c252-4901-8de1-beeaf6a59bbd could not be found. Jul 14 14:41:34.766213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '8bad9638-c252-4901-8de1-beeaf6a59bbd'} Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bad9638-c252-4901-8de1-beeaf6a59bbd could not be found. Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:41:34.767191 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:41:34.769280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:41:34.769280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:41:34.769280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:41:34.769280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:41:34.769280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:41:34.769280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:41:34.769280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:41:34.769280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bad9638-c252-4901-8de1-beeaf6a59bbd could not be found. Jul 14 14:41:34.769280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:41:34.769280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:34.769280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:41:34.769280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:34.769280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:34.769280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:34.769280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:41:34.769280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:41:34.769280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bad9638-c252-4901-8de1-beeaf6a59bbd could not be found. Jul 14 14:41:34.769280 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:41:34.770905 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-cc011ca4-f065-4284-8fd6-c0926366a8f1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Returning 404 to user: Instance 8bad9638-c252-4901-8de1-beeaf6a59bbd could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:41:34.770905 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-cc011ca4-f065-4284-8fd6-c0926366a8f1 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 404 len: 111 microversion: 2.20 time: 0.031841 Jul 14 14:41:34.770905 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 477/963] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:34 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:41:34.771182 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-2e825f91-323e-441b-8036-7224ecfa4ac3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '.version_select at 0x7f415fd9c820>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:34.898640 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-2e825f91-323e-441b-8036-7224ecfa4ac3 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-418223272" status: 204 len: 0 microversion: 2.20 time: 0.135633 Jul 14 14:41:34.899385 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 487/964] 10.222.0.93 () {60 vars in 1258 bytes} [Thu Jul 14 14:41:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-418223272 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 14:41:37.021096 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-4998c225-bcda-417f-b2e5-8962f5f75cea tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:37.021606 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-4998c225-bcda-417f-b2e5-8962f5f75cea tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:37.028092 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4998c225-bcda-417f-b2e5-8962f5f75cea tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:37.028539 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4998c225-bcda-417f-b2e5-8962f5f75cea tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:37.029293 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4998c225-bcda-417f-b2e5-8962f5f75cea tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:37.029731 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4998c225-bcda-417f-b2e5-8962f5f75cea tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:37.043699 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-4998c225-bcda-417f-b2e5-8962f5f75cea tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] HTTP exception thrown: Instance 8bad9638-c252-4901-8de1-beeaf6a59bbd could not be found. Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-4998c225-bcda-417f-b2e5-8962f5f75cea tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Request method failure captured: Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: DELETE /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd HTTP/1.1 Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0CnoYQbKwq8kU_5wNcosEgjOYNzujHJ85UInUmEl35vtd8o6ruzgGoSGgdKatIygkH6MtNbeI4n75875r1mVgJuc4qNgBbBxb1W_52tgpHaKGyIIXOSKCrGhE6XpTSHmT0fLG9WvbjpAR9Z20B_eJdUFeRnUwWDVjYXkaVsL5oClC7Y Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: 7378149db04942bdbc1035f0a3a902fe Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-377922018 Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:41:37.045240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:41:37.046955 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:41:37.046955 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-AttachVolumeShelveTestJSON-377922018 Jul 14 14:41:37.046955 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: 7378149db04942bdbc1035f0a3a902fe Jul 14 14:41:37.046955 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-377922018 Jul 14 14:41:37.046955 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-AttachVolumeShelveTestJSON-377922018-project Jul 14 14:41:37.046955 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:41:37.046955 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:41:37.046955 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 01c0469b67814077b4544cea54a0192e Jul 14 14:41:37.046955 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-AttachVolumeShelveTestJSON-377922018-project Jul 14 14:41:37.046955 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:41:37.046955 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 8bad9638-c252-4901-8de1-beeaf6a59bbd could not be found. Jul 14 14:41:37.046955 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '8bad9638-c252-4901-8de1-beeaf6a59bbd'} Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bad9638-c252-4901-8de1-beeaf6a59bbd could not be found. Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:41:37.047838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bad9638-c252-4901-8de1-beeaf6a59bbd could not be found. Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bad9638-c252-4901-8de1-beeaf6a59bbd could not be found. Jul 14 14:41:37.049320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:41:37.050976 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-4998c225-bcda-417f-b2e5-8962f5f75cea tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Returning 404 to user: Instance 8bad9638-c252-4901-8de1-beeaf6a59bbd could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:41:37.050976 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-4998c225-bcda-417f-b2e5-8962f5f75cea tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "DELETE /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 404 len: 111 microversion: 2.20 time: 0.029930 Jul 14 14:41:37.050976 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 478/965] 10.222.0.93 () {60 vars in 1279 bytes} [Thu Jul 14 14:41:37 2022] DELETE /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:41:37.055545 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0ba00691-4b6a-4dc6-a592-21f17942a783 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:37.056150 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-0ba00691-4b6a-4dc6-a592-21f17942a783 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 8bad9638-c252-4901-8de1-beeaf6a59bbd] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:37.062797 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0ba00691-4b6a-4dc6-a592-21f17942a783 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:37.063237 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0ba00691-4b6a-4dc6-a592-21f17942a783 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:37.063989 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0ba00691-4b6a-4dc6-a592-21f17942a783 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:37.064412 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-0ba00691-4b6a-4dc6-a592-21f17942a783 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:37.077458 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-0ba00691-4b6a-4dc6-a592-21f17942a783 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] HTTP exception thrown: Instance 8bad9638-c252-4901-8de1-beeaf6a59bbd could not be found. Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0ba00691-4b6a-4dc6-a592-21f17942a783 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Request method failure captured: Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd HTTP/1.1 Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0CnoYQbKwq8kU_5wNcosEgjOYNzujHJ85UInUmEl35vtd8o6ruzgGoSGgdKatIygkH6MtNbeI4n75875r1mVgJuc4qNgBbBxb1W_52tgpHaKGyIIXOSKCrGhE6XpTSHmT0fLG9WvbjpAR9Z20B_eJdUFeRnUwWDVjYXkaVsL5oClC7Y Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: 7378149db04942bdbc1035f0a3a902fe Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-377922018 Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:41:37.079133 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:41:37.081279 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:41:37.081279 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-AttachVolumeShelveTestJSON-377922018 Jul 14 14:41:37.081279 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: 7378149db04942bdbc1035f0a3a902fe Jul 14 14:41:37.081279 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-377922018 Jul 14 14:41:37.081279 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-AttachVolumeShelveTestJSON-377922018-project Jul 14 14:41:37.081279 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:41:37.081279 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:41:37.081279 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: 01c0469b67814077b4544cea54a0192e Jul 14 14:41:37.081279 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-AttachVolumeShelveTestJSON-377922018-project Jul 14 14:41:37.081279 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:41:37.081279 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Instance 8bad9638-c252-4901-8de1-beeaf6a59bbd could not be found. Jul 14 14:41:37.081279 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': '8bad9638-c252-4901-8de1-beeaf6a59bbd'} Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bad9638-c252-4901-8de1-beeaf6a59bbd could not be found. Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:41:37.082372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:41:37.083891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:41:37.083891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:41:37.083891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:41:37.083891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:41:37.083891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:41:37.083891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:41:37.083891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:41:37.083891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bad9638-c252-4901-8de1-beeaf6a59bbd could not be found. Jul 14 14:41:37.083891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:41:37.083891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:37.083891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:41:37.083891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:37.083891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:37.083891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:37.083891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:41:37.083891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:41:37.083891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bad9638-c252-4901-8de1-beeaf6a59bbd could not be found. Jul 14 14:41:37.083891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:41:37.085313 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-0ba00691-4b6a-4dc6-a592-21f17942a783 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Returning 404 to user: Instance 8bad9638-c252-4901-8de1-beeaf6a59bbd could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:41:37.085313 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-0ba00691-4b6a-4dc6-a592-21f17942a783 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd" status: 404 len: 111 microversion: 2.20 time: 0.029299 Jul 14 14:41:37.085313 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 488/966] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:37 2022] GET /compute/v2.1/servers/8bad9638-c252-4901-8de1-beeaf6a59bbd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:41:38.472748 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d5c59cbf-3aad-4469-9c4e-b3f1d4ce8e69 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:38.473262 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-d5c59cbf-3aad-4469-9c4e-b3f1d4ce8e69 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:38.479764 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d5c59cbf-3aad-4469-9c4e-b3f1d4ce8e69 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:38.480303 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d5c59cbf-3aad-4469-9c4e-b3f1d4ce8e69 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:38.481066 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d5c59cbf-3aad-4469-9c4e-b3f1d4ce8e69 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:38.481500 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d5c59cbf-3aad-4469-9c4e-b3f1d4ce8e69 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:38.495294 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-d5c59cbf-3aad-4469-9c4e-b3f1d4ce8e69 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] HTTP exception thrown: Instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 could not be found. Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d5c59cbf-3aad-4469-9c4e-b3f1d4ce8e69 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Request method failure captured: Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: DELETE /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 HTTP/1.1 Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0CnoYQbKwq8kU_5wNcosEgjOYNzujHJ85UInUmEl35vtd8o6ruzgGoSGgdKatIygkH6MtNbeI4n75875r1mVgJuc4qNgBbBxb1W_52tgpHaKGyIIXOSKCrGhE6XpTSHmT0fLG9WvbjpAR9Z20B_eJdUFeRnUwWDVjYXkaVsL5oClC7Y Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: 7378149db04942bdbc1035f0a3a902fe Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-377922018 Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:41:38.496912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:41:38.498657 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:41:38.498657 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-AttachVolumeShelveTestJSON-377922018 Jul 14 14:41:38.498657 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: 7378149db04942bdbc1035f0a3a902fe Jul 14 14:41:38.498657 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-377922018 Jul 14 14:41:38.498657 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-AttachVolumeShelveTestJSON-377922018-project Jul 14 14:41:38.498657 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:41:38.498657 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:41:38.498657 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 01c0469b67814077b4544cea54a0192e Jul 14 14:41:38.498657 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-AttachVolumeShelveTestJSON-377922018-project Jul 14 14:41:38.498657 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:41:38.498657 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 could not be found. Jul 14 14:41:38.498657 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '9d810a21-86d3-4d18-b9d6-eae39990ac26'} Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 could not be found. Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:41:38.499517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 could not be found. Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 could not be found. Jul 14 14:41:38.500997 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:41:38.503058 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d5c59cbf-3aad-4469-9c4e-b3f1d4ce8e69 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Returning 404 to user: Instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:41:38.503058 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-d5c59cbf-3aad-4469-9c4e-b3f1d4ce8e69 tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "DELETE /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 404 len: 111 microversion: 2.20 time: 0.029864 Jul 14 14:41:38.503058 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 479/967] 10.222.0.93 () {60 vars in 1279 bytes} [Thu Jul 14 14:41:38 2022] DELETE /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:41:38.507360 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c5a6d33d-b6fd-4e79-8250-52207baa9f9b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:38.507977 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c5a6d33d-b6fd-4e79-8250-52207baa9f9b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] [instance: 9d810a21-86d3-4d18-b9d6-eae39990ac26] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:38.514402 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c5a6d33d-b6fd-4e79-8250-52207baa9f9b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:38.514848 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c5a6d33d-b6fd-4e79-8250-52207baa9f9b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:38.515604 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c5a6d33d-b6fd-4e79-8250-52207baa9f9b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:38.516040 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c5a6d33d-b6fd-4e79-8250-52207baa9f9b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:38.532101 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-c5a6d33d-b6fd-4e79-8250-52207baa9f9b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] HTTP exception thrown: Instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 could not be found. Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c5a6d33d-b6fd-4e79-8250-52207baa9f9b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Request method failure captured: Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 HTTP/1.1 Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0CnoYQbKwq8kU_5wNcosEgjOYNzujHJ85UInUmEl35vtd8o6ruzgGoSGgdKatIygkH6MtNbeI4n75875r1mVgJuc4qNgBbBxb1W_52tgpHaKGyIIXOSKCrGhE6XpTSHmT0fLG9WvbjpAR9Z20B_eJdUFeRnUwWDVjYXkaVsL5oClC7Y Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: 7378149db04942bdbc1035f0a3a902fe Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-377922018 Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:41:38.533613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:41:38.535258 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/7378149db04942bdbc1035f0a3a902fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:41:38.535258 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-AttachVolumeShelveTestJSON-377922018 Jul 14 14:41:38.535258 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: 7378149db04942bdbc1035f0a3a902fe Jul 14 14:41:38.535258 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-377922018 Jul 14 14:41:38.535258 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-AttachVolumeShelveTestJSON-377922018-project Jul 14 14:41:38.535258 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:41:38.535258 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:41:38.535258 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: 01c0469b67814077b4544cea54a0192e Jul 14 14:41:38.535258 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-AttachVolumeShelveTestJSON-377922018-project Jul 14 14:41:38.535258 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:41:38.535258 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 could not be found. Jul 14 14:41:38.535258 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': '9d810a21-86d3-4d18-b9d6-eae39990ac26'} Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 could not be found. Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:41:38.536302 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:41:38.537733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:41:38.537733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:41:38.537733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:41:38.537733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:41:38.537733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:41:38.537733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:41:38.537733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:41:38.537733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 could not be found. Jul 14 14:41:38.537733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:41:38.537733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:38.537733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:41:38.537733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:38.537733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:38.537733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:38.537733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:41:38.537733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:41:38.537733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 could not be found. Jul 14 14:41:38.537733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:41:38.539081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c5a6d33d-b6fd-4e79-8250-52207baa9f9b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] Returning 404 to user: Instance 9d810a21-86d3-4d18-b9d6-eae39990ac26 could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:41:38.539081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c5a6d33d-b6fd-4e79-8250-52207baa9f9b tempest-AttachVolumeShelveTestJSON-377922018 tempest-AttachVolumeShelveTestJSON-377922018-project] 10.222.0.93 "GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26" status: 404 len: 111 microversion: 2.20 time: 0.031634 Jul 14 14:41:38.539081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 489/968] 10.222.0.93 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:38 2022] GET /compute/v2.1/servers/9d810a21-86d3-4d18-b9d6-eae39990ac26 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:41:46.358637 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-eecb4265-e49f-4a02-a660-3bdbea812761 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] Calling method '.version_select at 0x7f416c401820>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:46.405538 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-eecb4265-e49f-4a02-a660-3bdbea812761 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/c761d0ef-7142-491d-aaa4-56897948775b" status: 200 len: 350 microversion: 2.1 time: 0.050650 Jul 14 14:41:46.406131 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 480/969] 10.222.0.93 () {58 vars in 1244 bytes} [Thu Jul 14 14:41:46 2022] GET /compute/v2.1/os-volumes/c761d0ef-7142-491d-aaa4-56897948775b => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:48.161946 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-1af1e0a1-3383-48f2-aeb2-caf87a9eb9c1 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] Calling method '.version_select at 0x7f415fd92940>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:48.209171 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-1af1e0a1-3383-48f2-aeb2-caf87a9eb9c1 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/a8ea31b5-804d-468f-b0e1-1211ec9070c6" status: 200 len: 350 microversion: 2.1 time: 0.051751 Jul 14 14:41:48.209777 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 490/970] 10.222.0.93 () {58 vars in 1244 bytes} [Thu Jul 14 14:41:48 2022] GET /compute/v2.1/os-volumes/a8ea31b5-804d-468f-b0e1-1211ec9070c6 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:50.018894 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=12 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:50.019653 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=20 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:50.023425 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0bf5ec2d-47b2-43be-bfa1-422468db72b6 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] Calling method '.version_select at 0x7f416c324310>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:50.072128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0bf5ec2d-47b2-43be-bfa1-422468db72b6 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/6b94e575-d6ba-41a5-a5fb-4bf8dbfbb334" status: 200 len: 351 microversion: 2.1 time: 0.054824 Jul 14 14:41:50.072780 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 481/971] 10.222.0.93 () {58 vars in 1244 bytes} [Thu Jul 14 14:41:50 2022] GET /compute/v2.1/os-volumes/6b94e575-d6ba-41a5-a5fb-4bf8dbfbb334 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:50.081326 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:50.082121 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:50.086497 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-eb451261-91b1-41ad-9bb0-305a639f1438 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] Calling method '.version_select at 0x7f415fd32040>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:50.167763 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-eb451261-91b1-41ad-9bb0-305a639f1438 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] 10.222.0.93 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.087634 Jul 14 14:41:50.168540 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 491/972] 10.222.0.93 () {58 vars in 1133 bytes} [Thu Jul 14 14:41:50 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:50.181335 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ee7c0ec0-9859-4c04-ac0d-26390e50c428 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] Calling method '.version_select at 0x7f416c377e50>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:50.262304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ee7c0ec0-9859-4c04-ac0d-26390e50c428 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] 10.222.0.93 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085126 Jul 14 14:41:50.262877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 482/973] 10.222.0.93 () {58 vars in 1148 bytes} [Thu Jul 14 14:41:50 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:50.275610 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a5cc1a41-8bb1-47ca-a0db-542c05d3da68 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] Calling method '.version_select at 0x7f415fdde1f0>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:50.317279 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-74bd8cdb-358a-4213-bd5c-a5176f07f627 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:50.317793 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-74bd8cdb-358a-4213-bd5c-a5176f07f627 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:50.324058 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-74bd8cdb-358a-4213-bd5c-a5176f07f627 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:50.325246 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-74bd8cdb-358a-4213-bd5c-a5176f07f627 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:50.325944 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-74bd8cdb-358a-4213-bd5c-a5176f07f627 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:50.325944 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-74bd8cdb-358a-4213-bd5c-a5176f07f627 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:50.350698 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-74bd8cdb-358a-4213-bd5c-a5176f07f627 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca/ips" status: 200 len: 150 microversion: 2.1 time: 0.037254 Jul 14 14:41:50.351281 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 483/974] 10.222.0.93 () {58 vars in 1247 bytes} [Thu Jul 14 14:41:50 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:41:50.362157 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a5cc1a41-8bb1-47ca-a0db-542c05d3da68 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] 10.222.0.93 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090709 Jul 14 14:41:50.362958 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 492/975] 10.222.0.93 () {58 vars in 1133 bytes} [Thu Jul 14 14:41:50 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:50.375070 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-18c5afdf-67b7-4890-823e-ba552cce6fb0 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] Calling method '.version_select at 0x7f416c324a60>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:50.457255 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-18c5afdf-67b7-4890-823e-ba552cce6fb0 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] 10.222.0.93 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086221 Jul 14 14:41:50.457838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 484/976] 10.222.0.93 () {58 vars in 1166 bytes} [Thu Jul 14 14:41:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:50.469373 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-8e9ff0af-2b08-442c-a4ef-4c01c839ce76 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] Calling method '.version_select at 0x7f415fd03ee0>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:50.550897 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-8e9ff0af-2b08-442c-a4ef-4c01c839ce76 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085167 Jul 14 14:41:50.551531 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 493/977] 10.222.0.93 () {58 vars in 1169 bytes} [Thu Jul 14 14:41:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:50.563272 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a9981b4b-914c-4a64-a295-23f6cdf8adb6 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] Calling method '.version_select at 0x7f416c490d30>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:50.644513 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a9981b4b-914c-4a64-a295-23f6cdf8adb6 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084544 Jul 14 14:41:50.645092 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 485/978] 10.222.0.93 () {58 vars in 1154 bytes} [Thu Jul 14 14:41:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:50.656268 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-1aeac464-6457-43b4-8b81-86f3e1aa66d2 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] Calling method '.version_select at 0x7f415fdaca60>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:50.738052 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-1aeac464-6457-43b4-8b81-86f3e1aa66d2 tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085580 Jul 14 14:41:50.738767 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 494/979] 10.222.0.93 () {58 vars in 1187 bytes} [Thu Jul 14 14:41:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:50.750860 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ae21c1a1-8e25-409c-9be5-5eca848094cd tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] Calling method '.version_select at 0x7f416c330790>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:50.834991 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ae21c1a1-8e25-409c-9be5-5eca848094cd tempest-VolumesTestJSON-815781767 tempest-VolumesTestJSON-815781767-project] 10.222.0.93 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087908 Jul 14 14:41:50.835627 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 486/980] 10.222.0.93 () {58 vars in 1154 bytes} [Thu Jul 14 14:41:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:52.123244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-784065ec-691c-4714-a521-434c2170b457 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b545bda-a4d6-436e-990c-4ff1a706b2aa"}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:52.124506 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-784065ec-691c-4714-a521-434c2170b457 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:52.133574 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-784065ec-691c-4714-a521-434c2170b457 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:52.134047 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-784065ec-691c-4714-a521-434c2170b457 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:52.134882 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-784065ec-691c-4714-a521-434c2170b457 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:52.135360 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-784065ec-691c-4714-a521-434c2170b457 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:53.256511 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-784065ec-691c-4714-a521-434c2170b457 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "POST /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.138187 Jul 14 14:41:53.260620 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 495/981] 10.222.0.93 () {60 vars in 1322 bytes} [Thu Jul 14 14:41:52 2022] POST /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca/os-volume_attachments => generated 194 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:00.852172 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=2 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:00.853629 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=4 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:00.858773 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-1078b0e4-c5f7-4a46-a1c0-553806918525 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:00.859314 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-1078b0e4-c5f7-4a46-a1c0-553806918525 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:00.865246 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1078b0e4-c5f7-4a46-a1c0-553806918525 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:00.865694 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1078b0e4-c5f7-4a46-a1c0-553806918525 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:00.866537 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1078b0e4-c5f7-4a46-a1c0-553806918525 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:00.866965 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1078b0e4-c5f7-4a46-a1c0-553806918525 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:00.960896 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-1078b0e4-c5f7-4a46-a1c0-553806918525 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lazy-loading 'services' on Instance uuid 3662dbbd-4bda-437b-9974-53a4b0e35bca {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:42:01.199395 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-1078b0e4-c5f7-4a46-a1c0-553806918525 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca/os-volume_attachments/3b545bda-a4d6-436e-990c-4ff1a706b2aa" status: 202 len: 0 microversion: 2.1 time: 0.348291 Jul 14 14:42:01.200275 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 487/982] 10.222.0.93 () {58 vars in 1415 bytes} [Thu Jul 14 14:42:00 2022] DELETE /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca/os-volume_attachments/3b545bda-a4d6-436e-990c-4ff1a706b2aa => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:42:01.209954 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-fa3d6a31-46f5-4658-be9f-5c6087b5d630 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:01.217297 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-fa3d6a31-46f5-4658-be9f-5c6087b5d630 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:01.218008 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fa3d6a31-46f5-4658-be9f-5c6087b5d630 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:01.218463 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fa3d6a31-46f5-4658-be9f-5c6087b5d630 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:01.219233 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fa3d6a31-46f5-4658-be9f-5c6087b5d630 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:01.219653 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-fa3d6a31-46f5-4658-be9f-5c6087b5d630 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:01.249897 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-fa3d6a31-46f5-4658-be9f-5c6087b5d630 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044289 Jul 14 14:42:01.250456 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 496/983] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:42:01 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:42:02.263242 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-26c00c6b-d086-4b0f-a98f-e191a9548b28 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:02.264237 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-26c00c6b-d086-4b0f-a98f-e191a9548b28 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:02.270438 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-26c00c6b-d086-4b0f-a98f-e191a9548b28 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:02.270883 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-26c00c6b-d086-4b0f-a98f-e191a9548b28 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:02.271817 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-26c00c6b-d086-4b0f-a98f-e191a9548b28 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:02.272253 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-26c00c6b-d086-4b0f-a98f-e191a9548b28 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:02.301176 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-26c00c6b-d086-4b0f-a98f-e191a9548b28 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042782 Jul 14 14:42:02.301738 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 488/984] 10.222.0.93 () {58 vars in 1301 bytes} [Thu Jul 14 14:42:02 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:42:02.366431 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-5dd7e594-24f2-4477-ae31-5c8fbb64bd7a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:02.366942 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-5dd7e594-24f2-4477-ae31-5c8fbb64bd7a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:02.373169 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5dd7e594-24f2-4477-ae31-5c8fbb64bd7a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:02.373615 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5dd7e594-24f2-4477-ae31-5c8fbb64bd7a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:02.374401 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5dd7e594-24f2-4477-ae31-5c8fbb64bd7a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:02.374828 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5dd7e594-24f2-4477-ae31-5c8fbb64bd7a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:02.400213 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-5dd7e594-24f2-4477-ae31-5c8fbb64bd7a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Going to try to terminate instance {{(pid=118461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:42:02.755062 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-5dd7e594-24f2-4477-ae31-5c8fbb64bd7a tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca" status: 204 len: 0 microversion: 2.1 time: 0.392024 Jul 14 14:42:02.759884 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 497/985] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:42:02 2022] DELETE /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:42:02.765141 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-2f6995a8-1d80-4586-b579-b4b3db73cfde tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:02.765748 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-2f6995a8-1d80-4586-b579-b4b3db73cfde tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:02.772465 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2f6995a8-1d80-4586-b579-b4b3db73cfde tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:02.772908 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2f6995a8-1d80-4586-b579-b4b3db73cfde tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:02.773665 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2f6995a8-1d80-4586-b579-b4b3db73cfde tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:02.774122 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2f6995a8-1d80-4586-b579-b4b3db73cfde tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:02.907161 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-2f6995a8-1d80-4586-b579-b4b3db73cfde tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:02.916211 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-2f6995a8-1d80-4586-b579-b4b3db73cfde tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca" status: 200 len: 1680 microversion: 2.1 time: 0.154868 Jul 14 14:42:02.916783 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 489/986] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:02 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:03.934430 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-123f3500-e3f5-4a59-aaed-156eac487425 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:03.935187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-123f3500-e3f5-4a59-aaed-156eac487425 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:03.941670 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-123f3500-e3f5-4a59-aaed-156eac487425 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:03.942151 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-123f3500-e3f5-4a59-aaed-156eac487425 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:03.942910 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-123f3500-e3f5-4a59-aaed-156eac487425 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:03.943347 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-123f3500-e3f5-4a59-aaed-156eac487425 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:04.102880 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-123f3500-e3f5-4a59-aaed-156eac487425 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:04.110374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-123f3500-e3f5-4a59-aaed-156eac487425 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca" status: 200 len: 1680 microversion: 2.1 time: 0.180333 Jul 14 14:42:04.111565 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 498/987] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:03 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:05.128368 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-ce13035b-0df9-4dcf-a40c-7ee7c5258758 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:05.129003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-ce13035b-0df9-4dcf-a40c-7ee7c5258758 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:05.135661 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ce13035b-0df9-4dcf-a40c-7ee7c5258758 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:05.136051 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ce13035b-0df9-4dcf-a40c-7ee7c5258758 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:05.136827 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ce13035b-0df9-4dcf-a40c-7ee7c5258758 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:05.137241 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-ce13035b-0df9-4dcf-a40c-7ee7c5258758 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:05.230483 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-ce13035b-0df9-4dcf-a40c-7ee7c5258758 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:05.239442 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-8b16a1d7-c22c-4121-8379-a4b126b8eb2e req-206dbbcc-fd11-4278-bbed-fde03cf1c292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3662dbbd-4bda-437b-9974-53a4b0e35bca", "name": "network-vif-deleted", "tag": "cd39c8a0-4ff6-4ac9-943d-0fc4cc7967cb"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:05.249330 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-8b16a1d7-c22c-4121-8379-a4b126b8eb2e req-206dbbcc-fd11-4278-bbed-fde03cf1c292 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:05.249330 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-8b16a1d7-c22c-4121-8379-a4b126b8eb2e req-206dbbcc-fd11-4278-bbed-fde03cf1c292 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:05.255560 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-ce13035b-0df9-4dcf-a40c-7ee7c5258758 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca" status: 200 len: 1613 microversion: 2.1 time: 0.131726 Jul 14 14:42:05.265368 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 490/988] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:05 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca => generated 1613 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:05.284435 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-8b16a1d7-c22c-4121-8379-a4b126b8eb2e req-206dbbcc-fd11-4278-bbed-fde03cf1c292 service nova] Creating event network-vif-deleted:cd39c8a0-4ff6-4ac9-943d-0fc4cc7967cb for instance 3662dbbd-4bda-437b-9974-53a4b0e35bca on hv-cinder-79987 Jul 14 14:42:05.290720 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-8b16a1d7-c22c-4121-8379-a4b126b8eb2e req-206dbbcc-fd11-4278-bbed-fde03cf1c292 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054667 Jul 14 14:42:05.291838 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 499/989] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:06.272707 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c02ea402-3ef6-416c-9b44-2dfb4eb10d96 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:06.274021 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c02ea402-3ef6-416c-9b44-2dfb4eb10d96 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:06.280715 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c02ea402-3ef6-416c-9b44-2dfb4eb10d96 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:06.283029 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c02ea402-3ef6-416c-9b44-2dfb4eb10d96 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:06.283029 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c02ea402-3ef6-416c-9b44-2dfb4eb10d96 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:06.283227 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c02ea402-3ef6-416c-9b44-2dfb4eb10d96 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:06.478292 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c02ea402-3ef6-416c-9b44-2dfb4eb10d96 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:06.484282 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c02ea402-3ef6-416c-9b44-2dfb4eb10d96 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:06.484282 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-c02ea402-3ef6-416c-9b44-2dfb4eb10d96 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lazy-loading 'fault' on Instance uuid 3662dbbd-4bda-437b-9974-53a4b0e35bca {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:42:06.524472 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-c02ea402-3ef6-416c-9b44-2dfb4eb10d96 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98f00ffeef484dd489ed67b96d1ed783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb12869989f45cc875ecb36dd1f7aef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:06.531928 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c02ea402-3ef6-416c-9b44-2dfb4eb10d96 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca" status: 200 len: 1330 microversion: 2.1 time: 0.263239 Jul 14 14:42:06.533221 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 491/990] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:06 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca => generated 1330 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:07.551695 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-faef106e-9cf6-40a6-adcb-27efb47ab2c6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:07.552390 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-faef106e-9cf6-40a6-adcb-27efb47ab2c6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:07.558715 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-faef106e-9cf6-40a6-adcb-27efb47ab2c6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:07.559163 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-faef106e-9cf6-40a6-adcb-27efb47ab2c6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:07.559921 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-faef106e-9cf6-40a6-adcb-27efb47ab2c6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:07.560354 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-faef106e-9cf6-40a6-adcb-27efb47ab2c6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:07.576648 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-faef106e-9cf6-40a6-adcb-27efb47ab2c6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] HTTP exception thrown: Instance 3662dbbd-4bda-437b-9974-53a4b0e35bca could not be found. Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-faef106e-9cf6-40a6-adcb-27efb47ab2c6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Request method failure captured: Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca HTTP/1.1 Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0Coo2gQogloRyym-Nd5AKwohPbpaRVZzos2SNok6dsmiCUJQmaykmjw3JyCJGMIH4FxV3wh3mUDSl5SZMVXqBFX7Lk4CWppNzlNQJtOMoX0ubLPJKvnCDDOBuNYnggBOJcheNqaeVxGGln05C89djgP50UkOcd_oy4_GhZ5i307EiWw Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:42:07.578327 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:42:07.581953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:42:07.581953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:07.581953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:42:07.581953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:07.581953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:42:07.581953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:42:07.581953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:42:07.581953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: 98f00ffeef484dd489ed67b96d1ed783 Jul 14 14:42:07.581953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:42:07.581953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:42:07.581953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Instance 3662dbbd-4bda-437b-9974-53a4b0e35bca could not be found. Jul 14 14:42:07.581953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': '3662dbbd-4bda-437b-9974-53a4b0e35bca'} Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3662dbbd-4bda-437b-9974-53a4b0e35bca could not be found. Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:42:07.583011 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:42:07.584967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:42:07.584967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:42:07.584967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:42:07.584967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:42:07.584967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:42:07.584967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:42:07.584967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:42:07.584967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3662dbbd-4bda-437b-9974-53a4b0e35bca could not be found. Jul 14 14:42:07.584967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:07.584967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:07.584967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:07.584967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:07.584967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:07.584967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:07.584967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:42:07.584967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:42:07.584967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3662dbbd-4bda-437b-9974-53a4b0e35bca could not be found. Jul 14 14:42:07.584967 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:07.586428 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-faef106e-9cf6-40a6-adcb-27efb47ab2c6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Returning 404 to user: Instance 3662dbbd-4bda-437b-9974-53a4b0e35bca could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:42:07.586428 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-faef106e-9cf6-40a6-adcb-27efb47ab2c6 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca" status: 404 len: 111 microversion: 2.1 time: 0.033335 Jul 14 14:42:07.586428 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 500/991] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:07 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:42:07.589073 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-39d8aa65-578d-4ed1-a01a-19df2a05fb77 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '.version_select at 0x7f416c322e50>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:07.676476 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-39d8aa65-578d-4ed1-a01a-19df2a05fb77 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-385195187" status: 202 len: 0 microversion: 2.1 time: 0.091473 Jul 14 14:42:07.677072 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 492/992] 10.222.0.93 () {58 vars in 1217 bytes} [Thu Jul 14 14:42:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-385195187 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:42:09.930018 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b1a22517-d22b-424c-bba6-a6dc63916902 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:09.930536 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b1a22517-d22b-424c-bba6-a6dc63916902 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:09.936861 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b1a22517-d22b-424c-bba6-a6dc63916902 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:09.937284 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b1a22517-d22b-424c-bba6-a6dc63916902 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:09.938064 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b1a22517-d22b-424c-bba6-a6dc63916902 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:09.938613 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b1a22517-d22b-424c-bba6-a6dc63916902 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:09.952343 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-b1a22517-d22b-424c-bba6-a6dc63916902 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] HTTP exception thrown: Instance 3662dbbd-4bda-437b-9974-53a4b0e35bca could not be found. Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b1a22517-d22b-424c-bba6-a6dc63916902 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Request method failure captured: Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: DELETE /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca HTTP/1.1 Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0Coo2gQogloRyym-Nd5AKwohPbpaRVZzos2SNok6dsmiCUJQmaykmjw3JyCJGMIH4FxV3wh3mUDSl5SZMVXqBFX7Lk4CWppNzlNQJtOMoX0ubLPJKvnCDDOBuNYnggBOJcheNqaeVxGGln05C89djgP50UkOcd_oy4_GhZ5i307EiWw Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:42:09.953938 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:42:09.955510 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:42:09.955510 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:09.955510 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:42:09.955510 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:09.955510 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:42:09.955510 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:42:09.955510 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:42:09.955510 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: 98f00ffeef484dd489ed67b96d1ed783 Jul 14 14:42:09.955510 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:42:09.955510 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:42:09.955510 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Instance 3662dbbd-4bda-437b-9974-53a4b0e35bca could not be found. Jul 14 14:42:09.955510 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': '3662dbbd-4bda-437b-9974-53a4b0e35bca'} Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3662dbbd-4bda-437b-9974-53a4b0e35bca could not be found. Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:42:09.956341 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3662dbbd-4bda-437b-9974-53a4b0e35bca could not be found. Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3662dbbd-4bda-437b-9974-53a4b0e35bca could not be found. Jul 14 14:42:09.957842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:09.959250 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b1a22517-d22b-424c-bba6-a6dc63916902 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Returning 404 to user: Instance 3662dbbd-4bda-437b-9974-53a4b0e35bca could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:42:09.959250 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b1a22517-d22b-424c-bba6-a6dc63916902 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca" status: 404 len: 111 microversion: 2.1 time: 0.029197 Jul 14 14:42:09.959250 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 501/993] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:42:09 2022] DELETE /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:42:09.964378 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d2fd7309-e948-4a0c-8a86-d89a6bee185d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:09.965230 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-d2fd7309-e948-4a0c-8a86-d89a6bee185d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 3662dbbd-4bda-437b-9974-53a4b0e35bca] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:09.972654 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d2fd7309-e948-4a0c-8a86-d89a6bee185d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:09.973097 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d2fd7309-e948-4a0c-8a86-d89a6bee185d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:09.973888 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d2fd7309-e948-4a0c-8a86-d89a6bee185d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:09.974311 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d2fd7309-e948-4a0c-8a86-d89a6bee185d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:09.989476 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-d2fd7309-e948-4a0c-8a86-d89a6bee185d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] HTTP exception thrown: Instance 3662dbbd-4bda-437b-9974-53a4b0e35bca could not be found. Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d2fd7309-e948-4a0c-8a86-d89a6bee185d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Request method failure captured: Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca HTTP/1.1 Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0Coo2gQogloRyym-Nd5AKwohPbpaRVZzos2SNok6dsmiCUJQmaykmjw3JyCJGMIH4FxV3wh3mUDSl5SZMVXqBFX7Lk4CWppNzlNQJtOMoX0ubLPJKvnCDDOBuNYnggBOJcheNqaeVxGGln05C89djgP50UkOcd_oy4_GhZ5i307EiWw Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:42:09.991171 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:42:09.992801 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:42:09.992801 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:09.992801 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:42:09.992801 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:09.992801 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:42:09.992801 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:42:09.992801 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:42:09.992801 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 98f00ffeef484dd489ed67b96d1ed783 Jul 14 14:42:09.992801 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:42:09.992801 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:42:09.992801 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 3662dbbd-4bda-437b-9974-53a4b0e35bca could not be found. Jul 14 14:42:09.992801 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '3662dbbd-4bda-437b-9974-53a4b0e35bca'} Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3662dbbd-4bda-437b-9974-53a4b0e35bca could not be found. Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:42:09.993648 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:42:09.995022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:42:09.995022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:42:09.995022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:42:09.995022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:42:09.995022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:42:09.995022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:42:09.995022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:42:09.995022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3662dbbd-4bda-437b-9974-53a4b0e35bca could not be found. Jul 14 14:42:09.995022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:09.995022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:09.995022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:09.995022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:09.995022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:09.995022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:09.995022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:42:09.995022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:42:09.995022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3662dbbd-4bda-437b-9974-53a4b0e35bca could not be found. Jul 14 14:42:09.995022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:09.996137 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d2fd7309-e948-4a0c-8a86-d89a6bee185d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Returning 404 to user: Instance 3662dbbd-4bda-437b-9974-53a4b0e35bca could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:42:09.996137 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-d2fd7309-e948-4a0c-8a86-d89a6bee185d tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca" status: 404 len: 111 microversion: 2.1 time: 0.032671 Jul 14 14:42:09.996137 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 493/994] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:09 2022] GET /compute/v2.1/servers/3662dbbd-4bda-437b-9974-53a4b0e35bca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:42:11.304102 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4f421446-c4e5-455e-8123-01fec3a49e7b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:11.304619 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-4f421446-c4e5-455e-8123-01fec3a49e7b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:11.311239 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f421446-c4e5-455e-8123-01fec3a49e7b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:11.311704 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f421446-c4e5-455e-8123-01fec3a49e7b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:11.315139 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f421446-c4e5-455e-8123-01fec3a49e7b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:11.315139 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-4f421446-c4e5-455e-8123-01fec3a49e7b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:11.327081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-4f421446-c4e5-455e-8123-01fec3a49e7b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] HTTP exception thrown: Instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a could not be found. Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4f421446-c4e5-455e-8123-01fec3a49e7b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Request method failure captured: Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: DELETE /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a HTTP/1.1 Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0Coo2gQogloRyym-Nd5AKwohPbpaRVZzos2SNok6dsmiCUJQmaykmjw3JyCJGMIH4FxV3wh3mUDSl5SZMVXqBFX7Lk4CWppNzlNQJtOMoX0ubLPJKvnCDDOBuNYnggBOJcheNqaeVxGGln05C89djgP50UkOcd_oy4_GhZ5i307EiWw Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:42:11.328560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:42:11.330187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:42:11.330187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:11.330187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:42:11.330187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:11.330187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:42:11.330187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:42:11.330187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:42:11.330187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: 98f00ffeef484dd489ed67b96d1ed783 Jul 14 14:42:11.330187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:42:11.330187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:42:11.330187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a could not be found. Jul 14 14:42:11.330187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': '33dbec70-312c-4147-ac5f-5b74f2cfe64a'} Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a could not be found. Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:42:11.331057 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a could not be found. Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a could not be found. Jul 14 14:42:11.332355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.333659 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-4f421446-c4e5-455e-8123-01fec3a49e7b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Returning 404 to user: Instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:42:11.333659 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-4f421446-c4e5-455e-8123-01fec3a49e7b tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "DELETE /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a" status: 404 len: 111 microversion: 2.1 time: 0.029782 Jul 14 14:42:11.333659 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 502/995] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:42:11 2022] DELETE /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:42:11.338428 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0c399e44-02a3-476e-95ea-d01113ad89b0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:11.339028 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0c399e44-02a3-476e-95ea-d01113ad89b0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 33dbec70-312c-4147-ac5f-5b74f2cfe64a] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:11.346271 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0c399e44-02a3-476e-95ea-d01113ad89b0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:11.346705 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0c399e44-02a3-476e-95ea-d01113ad89b0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:11.347449 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0c399e44-02a3-476e-95ea-d01113ad89b0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:11.347873 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0c399e44-02a3-476e-95ea-d01113ad89b0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:11.361413 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-0c399e44-02a3-476e-95ea-d01113ad89b0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] HTTP exception thrown: Instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a could not be found. Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0c399e44-02a3-476e-95ea-d01113ad89b0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Request method failure captured: Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a HTTP/1.1 Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0Coo2gQogloRyym-Nd5AKwohPbpaRVZzos2SNok6dsmiCUJQmaykmjw3JyCJGMIH4FxV3wh3mUDSl5SZMVXqBFX7Lk4CWppNzlNQJtOMoX0ubLPJKvnCDDOBuNYnggBOJcheNqaeVxGGln05C89djgP50UkOcd_oy4_GhZ5i307EiWw Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:42:11.362948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:42:11.364595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:42:11.364595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:11.364595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:42:11.364595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:11.364595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:42:11.364595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:42:11.364595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:42:11.364595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 98f00ffeef484dd489ed67b96d1ed783 Jul 14 14:42:11.364595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:42:11.364595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:42:11.364595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a could not be found. Jul 14 14:42:11.364595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '33dbec70-312c-4147-ac5f-5b74f2cfe64a'} Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a could not be found. Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:42:11.365553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:42:11.367086 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:42:11.367086 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:42:11.367086 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:42:11.367086 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:42:11.367086 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:42:11.367086 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:42:11.367086 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:42:11.367086 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a could not be found. Jul 14 14:42:11.367086 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.367086 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:11.367086 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.367086 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:11.367086 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:11.367086 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:11.367086 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:42:11.367086 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:42:11.367086 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a could not be found. Jul 14 14:42:11.367086 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.368398 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0c399e44-02a3-476e-95ea-d01113ad89b0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Returning 404 to user: Instance 33dbec70-312c-4147-ac5f-5b74f2cfe64a could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:42:11.368398 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0c399e44-02a3-476e-95ea-d01113ad89b0 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a" status: 404 len: 111 microversion: 2.1 time: 0.029774 Jul 14 14:42:11.368398 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 494/996] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:11 2022] GET /compute/v2.1/servers/33dbec70-312c-4147-ac5f-5b74f2cfe64a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:42:11.373036 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-8bf808d2-9aa5-4091-a1a0-ddb56d4a055c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:11.373534 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-8bf808d2-9aa5-4091-a1a0-ddb56d4a055c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:11.380144 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8bf808d2-9aa5-4091-a1a0-ddb56d4a055c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:11.380614 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8bf808d2-9aa5-4091-a1a0-ddb56d4a055c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:11.381370 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8bf808d2-9aa5-4091-a1a0-ddb56d4a055c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:11.381901 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8bf808d2-9aa5-4091-a1a0-ddb56d4a055c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:11.395833 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-8bf808d2-9aa5-4091-a1a0-ddb56d4a055c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] HTTP exception thrown: Instance 0e5de64b-6114-45a7-8460-9c4379efd920 could not be found. Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-8bf808d2-9aa5-4091-a1a0-ddb56d4a055c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Request method failure captured: Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: DELETE /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 HTTP/1.1 Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0Coo2gQogloRyym-Nd5AKwohPbpaRVZzos2SNok6dsmiCUJQmaykmjw3JyCJGMIH4FxV3wh3mUDSl5SZMVXqBFX7Lk4CWppNzlNQJtOMoX0ubLPJKvnCDDOBuNYnggBOJcheNqaeVxGGln05C89djgP50UkOcd_oy4_GhZ5i307EiWw Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:42:11.397374 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:42:11.398972 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:42:11.398972 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:11.398972 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:42:11.398972 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:11.398972 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:42:11.398972 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:42:11.398972 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:42:11.398972 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: 98f00ffeef484dd489ed67b96d1ed783 Jul 14 14:42:11.398972 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:42:11.398972 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:42:11.398972 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Instance 0e5de64b-6114-45a7-8460-9c4379efd920 could not be found. Jul 14 14:42:11.398972 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': '0e5de64b-6114-45a7-8460-9c4379efd920'} Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e5de64b-6114-45a7-8460-9c4379efd920 could not be found. Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:42:11.399827 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e5de64b-6114-45a7-8460-9c4379efd920 could not be found. Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e5de64b-6114-45a7-8460-9c4379efd920 could not be found. Jul 14 14:42:11.401588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.403118 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-8bf808d2-9aa5-4091-a1a0-ddb56d4a055c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Returning 404 to user: Instance 0e5de64b-6114-45a7-8460-9c4379efd920 could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:42:11.403118 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-8bf808d2-9aa5-4091-a1a0-ddb56d4a055c tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "DELETE /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 404 len: 111 microversion: 2.1 time: 0.029855 Jul 14 14:42:11.403118 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 503/997] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:42:11 2022] DELETE /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:42:11.407259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-82203b45-f0cc-427c-a2f7-fa607771a9b5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:11.408071 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-82203b45-f0cc-427c-a2f7-fa607771a9b5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 0e5de64b-6114-45a7-8460-9c4379efd920] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:11.414356 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-82203b45-f0cc-427c-a2f7-fa607771a9b5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:11.415032 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-82203b45-f0cc-427c-a2f7-fa607771a9b5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:11.427272 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-82203b45-f0cc-427c-a2f7-fa607771a9b5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:11.427272 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-82203b45-f0cc-427c-a2f7-fa607771a9b5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:11.429315 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-82203b45-f0cc-427c-a2f7-fa607771a9b5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] HTTP exception thrown: Instance 0e5de64b-6114-45a7-8460-9c4379efd920 could not be found. Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-82203b45-f0cc-427c-a2f7-fa607771a9b5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Request method failure captured: Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 HTTP/1.1 Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0Coo2gQogloRyym-Nd5AKwohPbpaRVZzos2SNok6dsmiCUJQmaykmjw3JyCJGMIH4FxV3wh3mUDSl5SZMVXqBFX7Lk4CWppNzlNQJtOMoX0ubLPJKvnCDDOBuNYnggBOJcheNqaeVxGGln05C89djgP50UkOcd_oy4_GhZ5i307EiWw Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:42:11.430952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:42:11.432723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:42:11.432723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:11.432723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:42:11.432723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:11.432723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:42:11.432723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:42:11.432723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:42:11.432723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 98f00ffeef484dd489ed67b96d1ed783 Jul 14 14:42:11.432723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:42:11.432723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:42:11.432723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 0e5de64b-6114-45a7-8460-9c4379efd920 could not be found. Jul 14 14:42:11.432723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '0e5de64b-6114-45a7-8460-9c4379efd920'} Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e5de64b-6114-45a7-8460-9c4379efd920 could not be found. Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:42:11.433749 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:42:11.435273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:42:11.435273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:42:11.435273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:42:11.435273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:42:11.435273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:42:11.435273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:42:11.435273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:42:11.435273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e5de64b-6114-45a7-8460-9c4379efd920 could not be found. Jul 14 14:42:11.435273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.435273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:11.435273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.435273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:11.435273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:11.435273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:11.435273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:42:11.435273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:42:11.435273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e5de64b-6114-45a7-8460-9c4379efd920 could not be found. Jul 14 14:42:11.435273 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:11.436760 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-82203b45-f0cc-427c-a2f7-fa607771a9b5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Returning 404 to user: Instance 0e5de64b-6114-45a7-8460-9c4379efd920 could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:42:11.436760 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-82203b45-f0cc-427c-a2f7-fa607771a9b5 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920" status: 404 len: 111 microversion: 2.1 time: 0.028800 Jul 14 14:42:11.436760 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 495/998] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:11 2022] GET /compute/v2.1/servers/0e5de64b-6114-45a7-8460-9c4379efd920 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:42:12.664745 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c2da5670-6fc5-4ec1-aa9b-017143e766b7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:12.665244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c2da5670-6fc5-4ec1-aa9b-017143e766b7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:12.671913 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c2da5670-6fc5-4ec1-aa9b-017143e766b7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:12.672406 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c2da5670-6fc5-4ec1-aa9b-017143e766b7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:12.673188 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c2da5670-6fc5-4ec1-aa9b-017143e766b7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:12.673622 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c2da5670-6fc5-4ec1-aa9b-017143e766b7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:12.687161 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-c2da5670-6fc5-4ec1-aa9b-017143e766b7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] HTTP exception thrown: Instance 36276a10-ba93-4cae-abe5-f5484419f580 could not be found. Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c2da5670-6fc5-4ec1-aa9b-017143e766b7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Request method failure captured: Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: DELETE /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 HTTP/1.1 Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0Coo2gQogloRyym-Nd5AKwohPbpaRVZzos2SNok6dsmiCUJQmaykmjw3JyCJGMIH4FxV3wh3mUDSl5SZMVXqBFX7Lk4CWppNzlNQJtOMoX0ubLPJKvnCDDOBuNYnggBOJcheNqaeVxGGln05C89djgP50UkOcd_oy4_GhZ5i307EiWw Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:42:12.688688 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:42:12.690222 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:42:12.690222 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:12.690222 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:42:12.690222 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:12.690222 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:42:12.690222 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:42:12.690222 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:42:12.690222 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: 98f00ffeef484dd489ed67b96d1ed783 Jul 14 14:42:12.690222 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:42:12.690222 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:42:12.690222 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Instance 36276a10-ba93-4cae-abe5-f5484419f580 could not be found. Jul 14 14:42:12.690222 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': '36276a10-ba93-4cae-abe5-f5484419f580'} Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36276a10-ba93-4cae-abe5-f5484419f580 could not be found. Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:42:12.691022 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36276a10-ba93-4cae-abe5-f5484419f580 could not be found. Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36276a10-ba93-4cae-abe5-f5484419f580 could not be found. Jul 14 14:42:12.692321 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:42:12.693588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c2da5670-6fc5-4ec1-aa9b-017143e766b7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Returning 404 to user: Instance 36276a10-ba93-4cae-abe5-f5484419f580 could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:42:12.693588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c2da5670-6fc5-4ec1-aa9b-017143e766b7 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "DELETE /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580" status: 404 len: 111 microversion: 2.1 time: 0.029242 Jul 14 14:42:12.693588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 504/999] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:42:12 2022] DELETE /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:42:12.698511 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-2fac9283-09db-4cb0-a8b9-0451873ddf16 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:12.699114 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-2fac9283-09db-4cb0-a8b9-0451873ddf16 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] [instance: 36276a10-ba93-4cae-abe5-f5484419f580] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:12.705449 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2fac9283-09db-4cb0-a8b9-0451873ddf16 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:12.705922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2fac9283-09db-4cb0-a8b9-0451873ddf16 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:12.707181 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2fac9283-09db-4cb0-a8b9-0451873ddf16 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:12.707607 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2fac9283-09db-4cb0-a8b9-0451873ddf16 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:12.720708 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-2fac9283-09db-4cb0-a8b9-0451873ddf16 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] HTTP exception thrown: Instance 36276a10-ba93-4cae-abe5-f5484419f580 could not be found. Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-2fac9283-09db-4cb0-a8b9-0451873ddf16 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Request method failure captured: Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 HTTP/1.1 Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0Coo2gQogloRyym-Nd5AKwohPbpaRVZzos2SNok6dsmiCUJQmaykmjw3JyCJGMIH4FxV3wh3mUDSl5SZMVXqBFX7Lk4CWppNzlNQJtOMoX0ubLPJKvnCDDOBuNYnggBOJcheNqaeVxGGln05C89djgP50UkOcd_oy4_GhZ5i307EiWw Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:42:12.722902 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:42:12.724466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/abb12869989f45cc875ecb36dd1f7aef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:42:12.724466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:12.724466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: abb12869989f45cc875ecb36dd1f7aef Jul 14 14:42:12.724466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1364329329 Jul 14 14:42:12.724466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:42:12.724466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:42:12.724466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:42:12.724466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 98f00ffeef484dd489ed67b96d1ed783 Jul 14 14:42:12.724466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-AttachVolumeNegativeTest-1364329329-project Jul 14 14:42:12.724466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:42:12.724466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 36276a10-ba93-4cae-abe5-f5484419f580 could not be found. Jul 14 14:42:12.724466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '36276a10-ba93-4cae-abe5-f5484419f580'} Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36276a10-ba93-4cae-abe5-f5484419f580 could not be found. Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:42:12.725430 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:42:12.726994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:42:12.726994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:42:12.726994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:42:12.726994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:42:12.726994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:42:12.726994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:42:12.726994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:42:12.726994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36276a10-ba93-4cae-abe5-f5484419f580 could not be found. Jul 14 14:42:12.726994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:12.726994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:12.726994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:12.726994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:12.726994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:12.726994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:12.726994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:42:12.726994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:42:12.726994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36276a10-ba93-4cae-abe5-f5484419f580 could not be found. Jul 14 14:42:12.726994 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:42:12.728335 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-2fac9283-09db-4cb0-a8b9-0451873ddf16 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] Returning 404 to user: Instance 36276a10-ba93-4cae-abe5-f5484419f580 could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:42:12.728335 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-2fac9283-09db-4cb0-a8b9-0451873ddf16 tempest-AttachVolumeNegativeTest-1364329329 tempest-AttachVolumeNegativeTest-1364329329-project] 10.222.0.93 "GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580" status: 404 len: 111 microversion: 2.1 time: 0.029593 Jul 14 14:42:12.728335 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 496/1000] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:12 2022] GET /compute/v2.1/servers/36276a10-ba93-4cae-abe5-f5484419f580 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:42:46.196874 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:46.197632 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:46.377205 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d62c413e-2aa8-4f62-9faa-49abb30c9e4a tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Action: 'create', calling method: .version_select at 0x7f415fe69ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-503334875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO34wNGjAYrrI3bKAgi0Az4npthtgvP1ilGmnCJV7+zx1X03plQ1nlo2c6OEJOQwSjB+9MNliAYV8VfF9sVKxcZWIqcRqwFN/Jmdbb9LX3OOttQnbZDvmMRLDBtHQKA9VA=="}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:46.394253 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-d62c413e-2aa8-4f62-9faa-49abb30c9e4a tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Getting quotas for project 4c597b767cad4ce288fa65d68c5eaff5. Resources: {'key_pairs'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:42:46.398839 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-d62c413e-2aa8-4f62-9faa-49abb30c9e4a tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Getting quotas for user 79cca3fb8e6840e688fddecdbce20f1c and project 4c597b767cad4ce288fa65d68c5eaff5. Resources: {'key_pairs'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:42:46.504025 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d62c413e-2aa8-4f62-9faa-49abb30c9e4a tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.312088 Jul 14 14:42:46.504611 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 505/1001] 10.222.0.93 () {60 vars in 1158 bytes} [Thu Jul 14 14:42:46 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:08.766238 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-fb03b54b-cf3f-4827-b457-8a7d461e647f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1919165838", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-503334875", "security_groups": [{"name": "tempest-secgroup-smoke-633283655"}], "block_device_mapping_v2": [{"uuid": "ba3ff010-a20d-4824-9626-74aed761a847", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c6e7ee75-56fd-433e-9d2e-334d21d9fbeb"}]}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:08.775467 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:08.779384 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:08.878276 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.network.neutron [None req-fb03b54b-cf3f-4827-b457-8a7d461e647f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] validate_networks() for [('c6e7ee75-56fd-433e-9d2e-334d21d9fbeb', None, None, None, None, None)] {{(pid=118462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:43:09.426540 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-fb03b54b-cf3f-4827-b457-8a7d461e647f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Flavor limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:43:09.426540 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-fb03b54b-cf3f-4827-b457-8a7d461e647f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Image limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:43:09.426540 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-fb03b54b-cf3f-4827-b457-8a7d461e647f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Flavor pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:43:09.426540 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-fb03b54b-cf3f-4827-b457-8a7d461e647f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Image pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:43:09.426540 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-fb03b54b-cf3f-4827-b457-8a7d461e647f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:43:09.439304 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fb03b54b-cf3f-4827-b457-8a7d461e647f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:09.439755 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fb03b54b-cf3f-4827-b457-8a7d461e647f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:09.440556 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fb03b54b-cf3f-4827-b457-8a7d461e647f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:09.441073 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fb03b54b-cf3f-4827-b457-8a7d461e647f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:09.462470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-fb03b54b-cf3f-4827-b457-8a7d461e647f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Getting quotas for project 4c597b767cad4ce288fa65d68c5eaff5. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:43:09.466796 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-fb03b54b-cf3f-4827-b457-8a7d461e647f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Getting quotas for user 79cca3fb8e6840e688fddecdbce20f1c and project 4c597b767cad4ce288fa65d68c5eaff5. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:43:09.529465 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-fb03b54b-cf3f-4827-b457-8a7d461e647f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Going to run 1 instances... {{(pid=118462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:43:09.531571 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-fb03b54b-cf3f-4827-b457-8a7d461e647f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ba3ff010-a20d-4824-9626-74aed761a847',volume_size=None,volume_type=None)] {{(pid=118462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:43:10.028669 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-fb03b54b-cf3f-4827-b457-8a7d461e647f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.266212 Jul 14 14:43:10.029690 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 497/1002] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:43:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 1268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:43:10.037211 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=4 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:10.038002 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:10.041881 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-45a714e1-4f9b-499f-b483-f5b55da299a2 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:10.045744 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-45a714e1-4f9b-499f-b483-f5b55da299a2 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:10.104075 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-45a714e1-4f9b-499f-b483-f5b55da299a2 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:10.111402 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-45a714e1-4f9b-499f-b483-f5b55da299a2 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1094 microversion: 2.1 time: 0.076126 Jul 14 14:43:10.112491 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 506/1003] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:10 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:11.128974 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-eefef31f-069c-42c3-89f4-0fa4f05a3501 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:11.129583 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-eefef31f-069c-42c3-89f4-0fa4f05a3501 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:11.182347 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-eefef31f-069c-42c3-89f4-0fa4f05a3501 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:11.189025 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-eefef31f-069c-42c3-89f4-0fa4f05a3501 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1094 microversion: 2.1 time: 0.064449 Jul 14 14:43:11.189620 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 498/1004] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:11 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:12.206268 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-de70be2f-851a-4ae7-be73-f765dc1354ae tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:12.206883 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-de70be2f-851a-4ae7-be73-f765dc1354ae tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:12.214607 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-de70be2f-851a-4ae7-be73-f765dc1354ae tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:12.214986 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-de70be2f-851a-4ae7-be73-f765dc1354ae tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:12.215754 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-de70be2f-851a-4ae7-be73-f765dc1354ae tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:12.216313 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-de70be2f-851a-4ae7-be73-f765dc1354ae tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:12.278626 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-de70be2f-851a-4ae7-be73-f765dc1354ae tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:12.286909 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-de70be2f-851a-4ae7-be73-f765dc1354ae tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1192 microversion: 2.1 time: 0.085080 Jul 14 14:43:12.287479 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 507/1005] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:12 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:13.304798 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-5d23585d-6e81-48fe-9acb-63889ac8ad55 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:13.305390 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-5d23585d-6e81-48fe-9acb-63889ac8ad55 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:13.312380 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5d23585d-6e81-48fe-9acb-63889ac8ad55 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:13.312812 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5d23585d-6e81-48fe-9acb-63889ac8ad55 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:13.313561 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5d23585d-6e81-48fe-9acb-63889ac8ad55 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:13.314026 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5d23585d-6e81-48fe-9acb-63889ac8ad55 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:13.377647 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-5d23585d-6e81-48fe-9acb-63889ac8ad55 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:13.388286 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-5d23585d-6e81-48fe-9acb-63889ac8ad55 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1210 microversion: 2.1 time: 0.086183 Jul 14 14:43:13.388286 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 499/1006] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:13 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:14.404738 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-caaa0213-54e8-461a-9cd9-000a5ec8635b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:14.405411 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-caaa0213-54e8-461a-9cd9-000a5ec8635b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:14.412478 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-caaa0213-54e8-461a-9cd9-000a5ec8635b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:14.412923 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-caaa0213-54e8-461a-9cd9-000a5ec8635b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:14.413685 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-caaa0213-54e8-461a-9cd9-000a5ec8635b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:14.414139 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-caaa0213-54e8-461a-9cd9-000a5ec8635b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:14.580701 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-caaa0213-54e8-461a-9cd9-000a5ec8635b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:14.596043 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-caaa0213-54e8-461a-9cd9-000a5ec8635b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1265 microversion: 2.1 time: 0.195537 Jul 14 14:43:14.596621 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 508/1007] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:14 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:14.810527 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-682a0803-cd56-4a94-8810-9ca778d0cd09 req-ce075fd6-18be-4981-acaa-19f40b29b61c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c1cd5a3-6756-4243-9e5c-452d92bc8a09", "tag": "239ed8a3-d717-491c-ba96-59229a3802d1"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:14.821606 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-682a0803-cd56-4a94-8810-9ca778d0cd09 req-ce075fd6-18be-4981-acaa-19f40b29b61c service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:14.822089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-682a0803-cd56-4a94-8810-9ca778d0cd09 req-ce075fd6-18be-4981-acaa-19f40b29b61c service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:14.835420 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-682a0803-cd56-4a94-8810-9ca778d0cd09 req-ce075fd6-18be-4981-acaa-19f40b29b61c service nova] Creating event network-changed:239ed8a3-d717-491c-ba96-59229a3802d1 for instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 on hv-cinder-79987 Jul 14 14:43:14.841434 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-682a0803-cd56-4a94-8810-9ca778d0cd09 req-ce075fd6-18be-4981-acaa-19f40b29b61c service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035744 Jul 14 14:43:14.845699 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 500/1008] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:15.613597 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-bc97e358-ae67-4d0b-be58-04696c267f1f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:15.621704 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-bc97e358-ae67-4d0b-be58-04696c267f1f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:15.621704 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bc97e358-ae67-4d0b-be58-04696c267f1f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:15.621965 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bc97e358-ae67-4d0b-be58-04696c267f1f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:15.622605 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bc97e358-ae67-4d0b-be58-04696c267f1f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:15.623036 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bc97e358-ae67-4d0b-be58-04696c267f1f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:15.756449 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-bc97e358-ae67-4d0b-be58-04696c267f1f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:15.764114 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-bc97e358-ae67-4d0b-be58-04696c267f1f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1265 microversion: 2.1 time: 0.154438 Jul 14 14:43:15.764680 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 509/1009] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:15 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:16.782620 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-6a91343f-880a-4719-a792-958a2f3a091b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:16.783339 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-6a91343f-880a-4719-a792-958a2f3a091b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:16.790245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6a91343f-880a-4719-a792-958a2f3a091b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:16.790691 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6a91343f-880a-4719-a792-958a2f3a091b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:16.791445 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6a91343f-880a-4719-a792-958a2f3a091b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:16.791877 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6a91343f-880a-4719-a792-958a2f3a091b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:16.932382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-6a91343f-880a-4719-a792-958a2f3a091b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:16.940117 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-6a91343f-880a-4719-a792-958a2f3a091b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1265 microversion: 2.1 time: 0.162270 Jul 14 14:43:16.940690 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 501/1010] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:16 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:17.958345 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a6a668a7-f1ef-427b-8063-a9e10114bb5e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:17.958930 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a6a668a7-f1ef-427b-8063-a9e10114bb5e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:17.965808 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a6a668a7-f1ef-427b-8063-a9e10114bb5e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:17.966250 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a6a668a7-f1ef-427b-8063-a9e10114bb5e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:17.967130 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a6a668a7-f1ef-427b-8063-a9e10114bb5e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:17.967551 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a6a668a7-f1ef-427b-8063-a9e10114bb5e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:18.127357 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a6a668a7-f1ef-427b-8063-a9e10114bb5e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:18.135003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a6a668a7-f1ef-427b-8063-a9e10114bb5e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1265 microversion: 2.1 time: 0.181081 Jul 14 14:43:18.135572 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 510/1011] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:17 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:19.156120 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7b0a52f6-77d1-42ab-9d0e-650ee5431b06 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:19.156718 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-7b0a52f6-77d1-42ab-9d0e-650ee5431b06 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:19.163781 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7b0a52f6-77d1-42ab-9d0e-650ee5431b06 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:19.164224 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7b0a52f6-77d1-42ab-9d0e-650ee5431b06 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:19.164988 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7b0a52f6-77d1-42ab-9d0e-650ee5431b06 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:19.165418 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7b0a52f6-77d1-42ab-9d0e-650ee5431b06 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:19.319869 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7b0a52f6-77d1-42ab-9d0e-650ee5431b06 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:19.327265 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-7b0a52f6-77d1-42ab-9d0e-650ee5431b06 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1265 microversion: 2.1 time: 0.175535 Jul 14 14:43:19.327831 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 502/1012] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:19 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:20.343610 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-bbfbb819-caf2-4cfc-8140-a236ed447e42 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:20.344214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-bbfbb819-caf2-4cfc-8140-a236ed447e42 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:20.350750 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bbfbb819-caf2-4cfc-8140-a236ed447e42 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:20.351192 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bbfbb819-caf2-4cfc-8140-a236ed447e42 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:20.351974 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bbfbb819-caf2-4cfc-8140-a236ed447e42 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:20.352398 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-bbfbb819-caf2-4cfc-8140-a236ed447e42 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:20.509412 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-bbfbb819-caf2-4cfc-8140-a236ed447e42 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:20.520683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-bbfbb819-caf2-4cfc-8140-a236ed447e42 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1265 microversion: 2.1 time: 0.181170 Jul 14 14:43:20.521608 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 511/1013] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:20 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:21.538586 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-6b28248e-a3db-4d1a-b62b-25b7788f7908 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:21.539114 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-6b28248e-a3db-4d1a-b62b-25b7788f7908 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:21.541068 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=2 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:21.542539 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=8 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:21.547114 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6b28248e-a3db-4d1a-b62b-25b7788f7908 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:21.547564 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6b28248e-a3db-4d1a-b62b-25b7788f7908 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:21.548328 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6b28248e-a3db-4d1a-b62b-25b7788f7908 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:21.548764 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-6b28248e-a3db-4d1a-b62b-25b7788f7908 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:21.702647 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-6b28248e-a3db-4d1a-b62b-25b7788f7908 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:21.712111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-6b28248e-a3db-4d1a-b62b-25b7788f7908 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1265 microversion: 2.1 time: 0.177314 Jul 14 14:43:21.712595 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 503/1014] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:21 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:22.732187 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-5a6eb1fd-5d29-4812-8972-be1ffa9680c7 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:22.732733 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-5a6eb1fd-5d29-4812-8972-be1ffa9680c7 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:22.735248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:22.743470 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5a6eb1fd-5d29-4812-8972-be1ffa9680c7 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:22.743920 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5a6eb1fd-5d29-4812-8972-be1ffa9680c7 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:22.746593 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5a6eb1fd-5d29-4812-8972-be1ffa9680c7 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:22.747913 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5a6eb1fd-5d29-4812-8972-be1ffa9680c7 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:22.920646 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5a6eb1fd-5d29-4812-8972-be1ffa9680c7 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:22.928565 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-5a6eb1fd-5d29-4812-8972-be1ffa9680c7 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1265 microversion: 2.1 time: 0.200433 Jul 14 14:43:22.929088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 512/1015] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:22 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:23.947423 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e321c58d-22d5-4bd4-8f0f-6c7785c4274b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:23.948046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e321c58d-22d5-4bd4-8f0f-6c7785c4274b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:23.954197 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e321c58d-22d5-4bd4-8f0f-6c7785c4274b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:23.954850 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e321c58d-22d5-4bd4-8f0f-6c7785c4274b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:23.955473 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e321c58d-22d5-4bd4-8f0f-6c7785c4274b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:23.955910 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e321c58d-22d5-4bd4-8f0f-6c7785c4274b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:24.367777 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e321c58d-22d5-4bd4-8f0f-6c7785c4274b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:24.375433 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e321c58d-22d5-4bd4-8f0f-6c7785c4274b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1265 microversion: 2.1 time: 0.433456 Jul 14 14:43:24.375999 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 504/1016] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:23 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1265 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:43:25.392449 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b5ea5bdf-1925-4c95-bab1-f4adb2bdbf5b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:25.393105 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b5ea5bdf-1925-4c95-bab1-f4adb2bdbf5b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:25.400233 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b5ea5bdf-1925-4c95-bab1-f4adb2bdbf5b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:25.400719 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b5ea5bdf-1925-4c95-bab1-f4adb2bdbf5b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:25.401484 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b5ea5bdf-1925-4c95-bab1-f4adb2bdbf5b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:25.401951 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b5ea5bdf-1925-4c95-bab1-f4adb2bdbf5b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:25.543826 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b5ea5bdf-1925-4c95-bab1-f4adb2bdbf5b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:25.552116 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b5ea5bdf-1925-4c95-bab1-f4adb2bdbf5b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1265 microversion: 2.1 time: 0.163491 Jul 14 14:43:25.552719 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 513/1017] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:25 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:26.570606 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-90296aaf-8514-41cb-b23c-7040e6072a24 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:26.571208 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-90296aaf-8514-41cb-b23c-7040e6072a24 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:26.577395 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-90296aaf-8514-41cb-b23c-7040e6072a24 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:26.577876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-90296aaf-8514-41cb-b23c-7040e6072a24 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:26.578661 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-90296aaf-8514-41cb-b23c-7040e6072a24 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:26.579087 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-90296aaf-8514-41cb-b23c-7040e6072a24 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:26.716208 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-90296aaf-8514-41cb-b23c-7040e6072a24 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:26.724787 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-90296aaf-8514-41cb-b23c-7040e6072a24 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1265 microversion: 2.1 time: 0.158742 Jul 14 14:43:26.734017 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 505/1018] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:26 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:27.404292 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-d200b8ad-f0c0-4512-9347-3ddd45937f30 req-8813240e-f1a9-453b-a6f9-03c2af6fd7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1cd5a3-6756-4243-9e5c-452d92bc8a09", "name": "network-vif-plugged", "status": "completed", "tag": "239ed8a3-d717-491c-ba96-59229a3802d1"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:27.414338 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-d200b8ad-f0c0-4512-9347-3ddd45937f30 req-8813240e-f1a9-453b-a6f9-03c2af6fd7b5 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:27.415118 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-d200b8ad-f0c0-4512-9347-3ddd45937f30 req-8813240e-f1a9-453b-a6f9-03c2af6fd7b5 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:27.429583 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-d200b8ad-f0c0-4512-9347-3ddd45937f30 req-8813240e-f1a9-453b-a6f9-03c2af6fd7b5 service nova] Creating event network-vif-plugged:239ed8a3-d717-491c-ba96-59229a3802d1 for instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 on hv-cinder-79987 Jul 14 14:43:27.435045 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-d200b8ad-f0c0-4512-9347-3ddd45937f30 req-8813240e-f1a9-453b-a6f9-03c2af6fd7b5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191733 Jul 14 14:43:27.440058 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 514/1019] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:27.741043 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-cbf0f5e4-49e4-4b6c-bf3a-6785c62a1725 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:27.741629 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-cbf0f5e4-49e4-4b6c-bf3a-6785c62a1725 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:27.748321 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cbf0f5e4-49e4-4b6c-bf3a-6785c62a1725 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:27.748765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cbf0f5e4-49e4-4b6c-bf3a-6785c62a1725 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:27.749521 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cbf0f5e4-49e4-4b6c-bf3a-6785c62a1725 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:27.749981 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cbf0f5e4-49e4-4b6c-bf3a-6785c62a1725 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:27.909785 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-cbf0f5e4-49e4-4b6c-bf3a-6785c62a1725 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:27.919082 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-cbf0f5e4-49e4-4b6c-bf3a-6785c62a1725 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1265 microversion: 2.1 time: 0.182456 Jul 14 14:43:27.919755 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 506/1020] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:27 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:28.939635 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-7d12b12d-b15c-48e3-b7dc-9f9e7ee99880 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:28.940453 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-7d12b12d-b15c-48e3-b7dc-9f9e7ee99880 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:28.947067 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7d12b12d-b15c-48e3-b7dc-9f9e7ee99880 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:28.947508 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7d12b12d-b15c-48e3-b7dc-9f9e7ee99880 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:28.948273 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7d12b12d-b15c-48e3-b7dc-9f9e7ee99880 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:28.948698 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7d12b12d-b15c-48e3-b7dc-9f9e7ee99880 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:29.083310 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7d12b12d-b15c-48e3-b7dc-9f9e7ee99880 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:29.090885 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-7d12b12d-b15c-48e3-b7dc-9f9e7ee99880 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1265 microversion: 2.1 time: 0.158475 Jul 14 14:43:29.091485 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 515/1021] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:28 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:30.107572 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-cac14d66-332f-45c9-8f28-d50e5dc95d39 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:30.108183 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-cac14d66-332f-45c9-8f28-d50e5dc95d39 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:30.115524 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cac14d66-332f-45c9-8f28-d50e5dc95d39 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:30.116031 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cac14d66-332f-45c9-8f28-d50e5dc95d39 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:30.116865 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cac14d66-332f-45c9-8f28-d50e5dc95d39 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:30.117301 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-cac14d66-332f-45c9-8f28-d50e5dc95d39 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:30.257759 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-cac14d66-332f-45c9-8f28-d50e5dc95d39 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:30.267048 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-cac14d66-332f-45c9-8f28-d50e5dc95d39 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1450 microversion: 2.1 time: 0.163258 Jul 14 14:43:30.267645 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 507/1022] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:30 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:30.282872 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-786e28d0-011d-43f8-91ea-50b6d81c8b94 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:30.283493 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-786e28d0-011d-43f8-91ea-50b6d81c8b94 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:30.290796 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-786e28d0-011d-43f8-91ea-50b6d81c8b94 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:30.292804 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-786e28d0-011d-43f8-91ea-50b6d81c8b94 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:30.292804 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-786e28d0-011d-43f8-91ea-50b6d81c8b94 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:30.292804 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-786e28d0-011d-43f8-91ea-50b6d81c8b94 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:30.426619 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-786e28d0-011d-43f8-91ea-50b6d81c8b94 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:30.434300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-786e28d0-011d-43f8-91ea-50b6d81c8b94 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1450 microversion: 2.1 time: 0.155242 Jul 14 14:43:30.434870 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 516/1023] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:30 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:32.631624 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-bfe44bee-365b-4e31-bf1c-75084b24bfa7 req-be7db519-e685-4e85-952c-33b27ff8f50f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c1cd5a3-6756-4243-9e5c-452d92bc8a09", "tag": "239ed8a3-d717-491c-ba96-59229a3802d1"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:32.641401 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-bfe44bee-365b-4e31-bf1c-75084b24bfa7 req-be7db519-e685-4e85-952c-33b27ff8f50f service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:32.641873 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-bfe44bee-365b-4e31-bf1c-75084b24bfa7 req-be7db519-e685-4e85-952c-33b27ff8f50f service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:32.653596 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-bfe44bee-365b-4e31-bf1c-75084b24bfa7 req-be7db519-e685-4e85-952c-33b27ff8f50f service nova] Creating event network-changed:239ed8a3-d717-491c-ba96-59229a3802d1 for instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 on hv-cinder-79987 Jul 14 14:43:32.658878 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-bfe44bee-365b-4e31-bf1c-75084b24bfa7 req-be7db519-e685-4e85-952c-33b27ff8f50f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032033 Jul 14 14:43:32.659658 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 508/1024] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:57.806269 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-dca782a5-cb89-4566-81c5-b85cbd4f635e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-622727134", "imageRef": "7ea875a4-facb-4053-be2d-ff0080d2f3a0", "flavorRef": "452", "networks": [{"uuid": "1081dfe9-22b6-4327-b735-843c4b4f8748"}]}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:57.817738 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=24 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:57.818844 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=56 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:57.868549 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.network.neutron [None req-dca782a5-cb89-4566-81c5-b85cbd4f635e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] validate_networks() for [('1081dfe9-22b6-4327-b735-843c4b4f8748', None, None, None, None, None)] {{(pid=118461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:43:58.350994 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-dca782a5-cb89-4566-81c5-b85cbd4f635e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Flavor limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:43:58.351718 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-dca782a5-cb89-4566-81c5-b85cbd4f635e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Image limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:43:58.352471 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-dca782a5-cb89-4566-81c5-b85cbd4f635e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Flavor pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:43:58.353279 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-dca782a5-cb89-4566-81c5-b85cbd4f635e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Image pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:43:58.354412 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-dca782a5-cb89-4566-81c5-b85cbd4f635e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:43:58.365734 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dca782a5-cb89-4566-81c5-b85cbd4f635e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:58.366213 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dca782a5-cb89-4566-81c5-b85cbd4f635e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:58.366998 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dca782a5-cb89-4566-81c5-b85cbd4f635e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:58.367424 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-dca782a5-cb89-4566-81c5-b85cbd4f635e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:58.388088 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-dca782a5-cb89-4566-81c5-b85cbd4f635e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Getting quotas for project 39fed467abc64dc4931449d9c332fffe. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:43:58.392507 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-dca782a5-cb89-4566-81c5-b85cbd4f635e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Getting quotas for user a152b2998ccc45e5b28f952959ac0592 and project 39fed467abc64dc4931449d9c332fffe. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:43:58.404080 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-dca782a5-cb89-4566-81c5-b85cbd4f635e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Going to run 1 instances... {{(pid=118461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:43:58.406469 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-dca782a5-cb89-4566-81c5-b85cbd4f635e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ea875a4-facb-4053-be2d-ff0080d2f3a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:43:58.634191 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-dca782a5-cb89-4566-81c5-b85cbd4f635e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.834820 Jul 14 14:43:58.635142 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 517/1025] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:43:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:43:58.647363 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-99952d6d-a271-4d10-b90c-a7e735cad092 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:58.648059 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-99952d6d-a271-4d10-b90c-a7e735cad092 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:58.651211 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:58.657259 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=54 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:58.719343 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-99952d6d-a271-4d10-b90c-a7e735cad092 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:58.727415 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-99952d6d-a271-4d10-b90c-a7e735cad092 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 200 len: 1213 microversion: 2.1 time: 0.085421 Jul 14 14:43:58.728000 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 509/1026] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:58 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:59.746455 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-69a2cf7a-23cf-4962-ad9d-8f989979dea7 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:59.747417 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-69a2cf7a-23cf-4962-ad9d-8f989979dea7 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:59.809403 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-69a2cf7a-23cf-4962-ad9d-8f989979dea7 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:59.822473 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-69a2cf7a-23cf-4962-ad9d-8f989979dea7 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 200 len: 1213 microversion: 2.1 time: 0.081036 Jul 14 14:43:59.823492 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 518/1027] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:59 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:00.849566 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-edf9ab17-ed91-4f53-a0af-4064029059a2 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:00.850689 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-edf9ab17-ed91-4f53-a0af-4064029059a2 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:00.906032 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-edf9ab17-ed91-4f53-a0af-4064029059a2 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:00.918480 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-edf9ab17-ed91-4f53-a0af-4064029059a2 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 200 len: 1213 microversion: 2.1 time: 0.073158 Jul 14 14:44:00.919076 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 510/1028] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:00 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:01.938256 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-48755df6-b015-4838-be89-740d7b641ded tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:01.939112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-48755df6-b015-4838-be89-740d7b641ded tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:02.001268 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-48755df6-b015-4838-be89-740d7b641ded tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:02.008871 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-48755df6-b015-4838-be89-740d7b641ded tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 200 len: 1213 microversion: 2.1 time: 0.075451 Jul 14 14:44:02.009456 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 519/1029] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:01 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:03.026689 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-5b130e98-5663-4372-9280-cc1263a6dbf6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:03.027309 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-5b130e98-5663-4372-9280-cc1263a6dbf6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:03.034502 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5b130e98-5663-4372-9280-cc1263a6dbf6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:03.035027 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5b130e98-5663-4372-9280-cc1263a6dbf6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:03.035773 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5b130e98-5663-4372-9280-cc1263a6dbf6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:03.036212 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-5b130e98-5663-4372-9280-cc1263a6dbf6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:03.112802 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-5b130e98-5663-4372-9280-cc1263a6dbf6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:03.117416 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-5b130e98-5663-4372-9280-cc1263a6dbf6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 200 len: 1217 microversion: 2.1 time: 0.095174 Jul 14 14:44:03.118044 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 511/1030] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:03 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:04.135299 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-6a90d147-ba23-498a-895d-da51983e18b6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:04.139076 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-6a90d147-ba23-498a-895d-da51983e18b6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:04.143326 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6a90d147-ba23-498a-895d-da51983e18b6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:04.143773 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6a90d147-ba23-498a-895d-da51983e18b6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:04.145457 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6a90d147-ba23-498a-895d-da51983e18b6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:04.145457 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-6a90d147-ba23-498a-895d-da51983e18b6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:04.214590 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-6a90d147-ba23-498a-895d-da51983e18b6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:04.222964 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-6a90d147-ba23-498a-895d-da51983e18b6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 200 len: 1217 microversion: 2.1 time: 0.092097 Jul 14 14:44:04.223543 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 520/1031] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:04 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:05.241036 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-2f131efb-eff0-4356-bf9c-7fbe261db213 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:05.241641 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-2f131efb-eff0-4356-bf9c-7fbe261db213 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:05.248610 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2f131efb-eff0-4356-bf9c-7fbe261db213 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:05.249045 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2f131efb-eff0-4356-bf9c-7fbe261db213 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:05.249848 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2f131efb-eff0-4356-bf9c-7fbe261db213 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:05.250278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-2f131efb-eff0-4356-bf9c-7fbe261db213 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:05.316794 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-2f131efb-eff0-4356-bf9c-7fbe261db213 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:05.324433 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-2f131efb-eff0-4356-bf9c-7fbe261db213 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 200 len: 1265 microversion: 2.1 time: 0.087775 Jul 14 14:44:05.325021 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 512/1032] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:05 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:06.343266 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-9b459c09-1333-487d-9e7a-bbe6f3d28dc6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:06.343947 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-9b459c09-1333-487d-9e7a-bbe6f3d28dc6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:06.351910 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9b459c09-1333-487d-9e7a-bbe6f3d28dc6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:06.352355 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9b459c09-1333-487d-9e7a-bbe6f3d28dc6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:06.353316 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9b459c09-1333-487d-9e7a-bbe6f3d28dc6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:06.353738 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-9b459c09-1333-487d-9e7a-bbe6f3d28dc6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:06.426381 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-9b459c09-1333-487d-9e7a-bbe6f3d28dc6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:06.434211 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-9b459c09-1333-487d-9e7a-bbe6f3d28dc6 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 200 len: 1271 microversion: 2.1 time: 0.095194 Jul 14 14:44:06.434801 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 521/1033] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:06 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:07.452472 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-4c72d53b-c3a9-4c37-a087-0ee1a494751f tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:07.453208 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-4c72d53b-c3a9-4c37-a087-0ee1a494751f tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:07.462479 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4c72d53b-c3a9-4c37-a087-0ee1a494751f tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:07.462941 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4c72d53b-c3a9-4c37-a087-0ee1a494751f tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:07.463813 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4c72d53b-c3a9-4c37-a087-0ee1a494751f tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:07.464195 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4c72d53b-c3a9-4c37-a087-0ee1a494751f tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:07.610043 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-4c72d53b-c3a9-4c37-a087-0ee1a494751f tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:07.618341 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-4c72d53b-c3a9-4c37-a087-0ee1a494751f tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 200 len: 1313 microversion: 2.1 time: 0.169415 Jul 14 14:44:07.618933 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 513/1034] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:07 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:07.719293 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-da1f59d7-0f6f-4e72-9227-c327a714aa65 req-d81d63ff-b5aa-4084-9e8c-fdd0d082c5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1538a760-c1f4-4676-bb55-6592d5ca3021", "tag": "2eaa8773-d936-4d7c-80e4-01bf3c13a4db"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:07.730754 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-da1f59d7-0f6f-4e72-9227-c327a714aa65 req-d81d63ff-b5aa-4084-9e8c-fdd0d082c5f5 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:07.731200 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-da1f59d7-0f6f-4e72-9227-c327a714aa65 req-d81d63ff-b5aa-4084-9e8c-fdd0d082c5f5 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:07.743617 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-da1f59d7-0f6f-4e72-9227-c327a714aa65 req-d81d63ff-b5aa-4084-9e8c-fdd0d082c5f5 service nova] Creating event network-changed:2eaa8773-d936-4d7c-80e4-01bf3c13a4db for instance 1538a760-c1f4-4676-bb55-6592d5ca3021 on hv-cinder-79987 Jul 14 14:44:07.748819 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-da1f59d7-0f6f-4e72-9227-c327a714aa65 req-d81d63ff-b5aa-4084-9e8c-fdd0d082c5f5 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034515 Jul 14 14:44:07.749499 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 522/1035] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:08.635812 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7d2dce2f-2277-408c-b243-371849827289 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:08.636383 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-7d2dce2f-2277-408c-b243-371849827289 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:08.644074 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7d2dce2f-2277-408c-b243-371849827289 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:08.644517 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7d2dce2f-2277-408c-b243-371849827289 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:08.645286 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7d2dce2f-2277-408c-b243-371849827289 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:08.645852 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7d2dce2f-2277-408c-b243-371849827289 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:08.784684 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7d2dce2f-2277-408c-b243-371849827289 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:08.792627 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-7d2dce2f-2277-408c-b243-371849827289 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 200 len: 1313 microversion: 2.1 time: 0.160892 Jul 14 14:44:08.793213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 514/1036] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:08 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:09.807544 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:09.812344 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-10eb124e-3f49-4407-90b3-2d8ca256af69 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:09.813055 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-10eb124e-3f49-4407-90b3-2d8ca256af69 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:09.819734 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-10eb124e-3f49-4407-90b3-2d8ca256af69 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:09.820177 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-10eb124e-3f49-4407-90b3-2d8ca256af69 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:09.820969 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-10eb124e-3f49-4407-90b3-2d8ca256af69 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:09.821398 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-10eb124e-3f49-4407-90b3-2d8ca256af69 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:09.966555 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-10eb124e-3f49-4407-90b3-2d8ca256af69 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:09.975354 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-10eb124e-3f49-4407-90b3-2d8ca256af69 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 200 len: 1313 microversion: 2.1 time: 0.168665 Jul 14 14:44:09.975935 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 523/1037] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:09 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:10.992553 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f54795bc-50da-4f28-9fc3-24e570deb20e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:10.993147 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f54795bc-50da-4f28-9fc3-24e570deb20e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:10.995489 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=4 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:11.000577 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f54795bc-50da-4f28-9fc3-24e570deb20e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:11.001022 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f54795bc-50da-4f28-9fc3-24e570deb20e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:11.001810 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f54795bc-50da-4f28-9fc3-24e570deb20e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:11.002252 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f54795bc-50da-4f28-9fc3-24e570deb20e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:11.132775 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f54795bc-50da-4f28-9fc3-24e570deb20e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:11.140274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f54795bc-50da-4f28-9fc3-24e570deb20e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 200 len: 1313 microversion: 2.1 time: 0.151636 Jul 14 14:44:11.140838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 515/1038] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:10 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:12.157645 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-3b61ee97-3c7a-4c3c-9bbc-57869d4ee9dd tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:12.158289 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-3b61ee97-3c7a-4c3c-9bbc-57869d4ee9dd tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:12.160670 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=10 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:12.165550 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b61ee97-3c7a-4c3c-9bbc-57869d4ee9dd tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:12.166670 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b61ee97-3c7a-4c3c-9bbc-57869d4ee9dd tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:12.167443 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b61ee97-3c7a-4c3c-9bbc-57869d4ee9dd tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:12.167879 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3b61ee97-3c7a-4c3c-9bbc-57869d4ee9dd tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:12.300475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3b61ee97-3c7a-4c3c-9bbc-57869d4ee9dd tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:12.307814 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-3b61ee97-3c7a-4c3c-9bbc-57869d4ee9dd tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 200 len: 1313 microversion: 2.1 time: 0.154084 Jul 14 14:44:12.308382 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 524/1039] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:12 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:13.328144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-77a5a511-a4c1-444e-811c-62146177e2ad tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:13.328777 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-77a5a511-a4c1-444e-811c-62146177e2ad tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:13.335481 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-77a5a511-a4c1-444e-811c-62146177e2ad tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:13.335921 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-77a5a511-a4c1-444e-811c-62146177e2ad tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:13.336715 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-77a5a511-a4c1-444e-811c-62146177e2ad tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:13.337210 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-77a5a511-a4c1-444e-811c-62146177e2ad tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:13.458082 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-53915653-c5ac-4dee-b3e0-4dba9301124c req-d3df29b6-6951-439f-b743-c34e686b41e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1538a760-c1f4-4676-bb55-6592d5ca3021", "name": "network-vif-plugged", "status": "completed", "tag": "2eaa8773-d936-4d7c-80e4-01bf3c13a4db"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:13.472354 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-53915653-c5ac-4dee-b3e0-4dba9301124c req-d3df29b6-6951-439f-b743-c34e686b41e4 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:13.473292 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-53915653-c5ac-4dee-b3e0-4dba9301124c req-d3df29b6-6951-439f-b743-c34e686b41e4 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:13.475040 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-77a5a511-a4c1-444e-811c-62146177e2ad tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:13.483201 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-77a5a511-a4c1-444e-811c-62146177e2ad tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 200 len: 1313 microversion: 2.1 time: 0.162050 Jul 14 14:44:13.483906 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 516/1040] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:13 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:13.491897 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-53915653-c5ac-4dee-b3e0-4dba9301124c req-d3df29b6-6951-439f-b743-c34e686b41e4 service nova] Creating event network-vif-plugged:2eaa8773-d936-4d7c-80e4-01bf3c13a4db for instance 1538a760-c1f4-4676-bb55-6592d5ca3021 on hv-cinder-79987 Jul 14 14:44:13.498499 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-53915653-c5ac-4dee-b3e0-4dba9301124c req-d3df29b6-6951-439f-b743-c34e686b41e4 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047105 Jul 14 14:44:13.499160 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 525/1041] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:44:14.500312 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0e61db71-8ab7-4338-a723-f8bb7d86070d tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:14.500911 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0e61db71-8ab7-4338-a723-f8bb7d86070d tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:14.507546 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0e61db71-8ab7-4338-a723-f8bb7d86070d tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:14.507984 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0e61db71-8ab7-4338-a723-f8bb7d86070d tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:14.508727 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0e61db71-8ab7-4338-a723-f8bb7d86070d tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:14.509152 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0e61db71-8ab7-4338-a723-f8bb7d86070d tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:14.644735 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-0e61db71-8ab7-4338-a723-f8bb7d86070d tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:14.652159 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0e61db71-8ab7-4338-a723-f8bb7d86070d tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 200 len: 1313 microversion: 2.1 time: 0.155728 Jul 14 14:44:14.652731 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 517/1042] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:14 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:15.669676 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b1caaee7-753c-4d1f-a6d6-4afb4e875477 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:15.670445 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b1caaee7-753c-4d1f-a6d6-4afb4e875477 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:15.676717 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b1caaee7-753c-4d1f-a6d6-4afb4e875477 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:15.677165 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b1caaee7-753c-4d1f-a6d6-4afb4e875477 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:15.677956 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b1caaee7-753c-4d1f-a6d6-4afb4e875477 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:15.678392 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b1caaee7-753c-4d1f-a6d6-4afb4e875477 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:15.810606 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b1caaee7-753c-4d1f-a6d6-4afb4e875477 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:15.818365 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b1caaee7-753c-4d1f-a6d6-4afb4e875477 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 200 len: 1497 microversion: 2.1 time: 0.153491 Jul 14 14:44:15.818934 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 526/1043] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:15 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:16.643581 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-57a6a65b-2517-41bb-86fe-b2102cd6a9ce tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:16.644213 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-57a6a65b-2517-41bb-86fe-b2102cd6a9ce tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:16.650848 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-57a6a65b-2517-41bb-86fe-b2102cd6a9ce tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:16.651286 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-57a6a65b-2517-41bb-86fe-b2102cd6a9ce tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:16.652130 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-57a6a65b-2517-41bb-86fe-b2102cd6a9ce tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:16.652559 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-57a6a65b-2517-41bb-86fe-b2102cd6a9ce tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:16.677718 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-57a6a65b-2517-41bb-86fe-b2102cd6a9ce tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Going to try to terminate instance {{(pid=118462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:44:17.065303 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-57a6a65b-2517-41bb-86fe-b2102cd6a9ce tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "DELETE /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 204 len: 0 microversion: 2.1 time: 0.425902 Jul 14 14:44:17.066076 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 518/1044] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:44:16 2022] DELETE /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:44:17.074076 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-deb34a3a-18ed-4fd2-8b5a-5c07dd8c88ff tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:17.074680 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-deb34a3a-18ed-4fd2-8b5a-5c07dd8c88ff tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:17.081289 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-deb34a3a-18ed-4fd2-8b5a-5c07dd8c88ff tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:17.081744 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-deb34a3a-18ed-4fd2-8b5a-5c07dd8c88ff tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:17.082550 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-deb34a3a-18ed-4fd2-8b5a-5c07dd8c88ff tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:17.082973 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-deb34a3a-18ed-4fd2-8b5a-5c07dd8c88ff tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:17.210582 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-deb34a3a-18ed-4fd2-8b5a-5c07dd8c88ff tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:17.218403 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-deb34a3a-18ed-4fd2-8b5a-5c07dd8c88ff tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 200 len: 1503 microversion: 2.1 time: 0.148117 Jul 14 14:44:17.218971 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 527/1045] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:17 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:18.237560 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-0c630235-faf2-48ec-86a7-0ef6ff97649d tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:18.238285 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-0c630235-faf2-48ec-86a7-0ef6ff97649d tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:18.244252 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0c630235-faf2-48ec-86a7-0ef6ff97649d tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:18.244691 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0c630235-faf2-48ec-86a7-0ef6ff97649d tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:18.245438 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0c630235-faf2-48ec-86a7-0ef6ff97649d tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:18.245894 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-0c630235-faf2-48ec-86a7-0ef6ff97649d tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:18.385969 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-0c630235-faf2-48ec-86a7-0ef6ff97649d tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:18.393611 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-0c630235-faf2-48ec-86a7-0ef6ff97649d tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 200 len: 1503 microversion: 2.1 time: 0.161828 Jul 14 14:44:18.394278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 519/1046] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:18 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:18.938741 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-14fc7ab5-a0ec-49cf-92f3-2d996731ea0b req-5e0615ab-9877-4d52-b543-f80653fc8a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1538a760-c1f4-4676-bb55-6592d5ca3021", "name": "network-vif-deleted", "tag": "2eaa8773-d936-4d7c-80e4-01bf3c13a4db"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:18.950542 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-14fc7ab5-a0ec-49cf-92f3-2d996731ea0b req-5e0615ab-9877-4d52-b543-f80653fc8a95 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:18.951033 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-14fc7ab5-a0ec-49cf-92f3-2d996731ea0b req-5e0615ab-9877-4d52-b543-f80653fc8a95 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:18.962706 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-14fc7ab5-a0ec-49cf-92f3-2d996731ea0b req-5e0615ab-9877-4d52-b543-f80653fc8a95 service nova] Creating event network-vif-deleted:2eaa8773-d936-4d7c-80e4-01bf3c13a4db for instance 1538a760-c1f4-4676-bb55-6592d5ca3021 on hv-cinder-79987 Jul 14 14:44:18.968048 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-14fc7ab5-a0ec-49cf-92f3-2d996731ea0b req-5e0615ab-9877-4d52-b543-f80653fc8a95 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033162 Jul 14 14:44:18.968650 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 528/1047] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:19.411283 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-3cd13de0-16c8-4abe-82a4-818f105a4256 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:19.411897 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-3cd13de0-16c8-4abe-82a4-818f105a4256 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:19.418491 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3cd13de0-16c8-4abe-82a4-818f105a4256 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:19.418939 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3cd13de0-16c8-4abe-82a4-818f105a4256 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:19.419694 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3cd13de0-16c8-4abe-82a4-818f105a4256 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:19.420128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3cd13de0-16c8-4abe-82a4-818f105a4256 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:19.450401 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3cd13de0-16c8-4abe-82a4-818f105a4256 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:19.450844 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-3cd13de0-16c8-4abe-82a4-818f105a4256 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:19.451283 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-3cd13de0-16c8-4abe-82a4-818f105a4256 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lazy-loading 'fault' on Instance uuid 1538a760-c1f4-4676-bb55-6592d5ca3021 {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:44:19.494438 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-3cd13de0-16c8-4abe-82a4-818f105a4256 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:19.502382 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-3cd13de0-16c8-4abe-82a4-818f105a4256 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 200 len: 1303 microversion: 2.1 time: 0.095624 Jul 14 14:44:19.502939 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 520/1048] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:19 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:20.520882 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-34b61b93-f0be-4163-a1ca-79b60592bcf8 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:20.521575 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-34b61b93-f0be-4163-a1ca-79b60592bcf8 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: 1538a760-c1f4-4676-bb55-6592d5ca3021] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:20.527843 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-34b61b93-f0be-4163-a1ca-79b60592bcf8 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:20.528285 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-34b61b93-f0be-4163-a1ca-79b60592bcf8 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:20.529039 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-34b61b93-f0be-4163-a1ca-79b60592bcf8 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:20.529472 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-34b61b93-f0be-4163-a1ca-79b60592bcf8 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:20.543017 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-34b61b93-f0be-4163-a1ca-79b60592bcf8 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] HTTP exception thrown: Instance 1538a760-c1f4-4676-bb55-6592d5ca3021 could not be found. Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-34b61b93-f0be-4163-a1ca-79b60592bcf8 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Request method failure captured: Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 HTTP/1.1 Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0CurNA_TWvAkui6BDEujIez19t1eh8zZa_Iy_UHwd7XXoCkk4U83lwrHMlwxCtfd7BhbvkI3HpE9GoB4sWmDbAhBQ6PCZTbU5HMs3OlK8AoPZzfhySanybThlLL4aC7xr28ezYAgrDokQ0DmC5xdSR_Jmx8n7CI8hQxpPBBNsjW4pVU Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: 39fed467abc64dc4931449d9c332fffe Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-VolumesActionsTest-1063862574 Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:44:20.544623 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:44:20.546314 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_39fed467abc64dc4931449d9c332fffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39fed467abc64dc4931449d9c332fffe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/39fed467abc64dc4931449d9c332fffe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39fed467abc64dc4931449d9c332fffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:44:20.546314 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-VolumesActionsTest-1063862574 Jul 14 14:44:20.546314 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: 39fed467abc64dc4931449d9c332fffe Jul 14 14:44:20.546314 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-VolumesActionsTest-1063862574 Jul 14 14:44:20.546314 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-VolumesActionsTest-1063862574-project Jul 14 14:44:20.546314 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:44:20.546314 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:44:20.546314 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: a152b2998ccc45e5b28f952959ac0592 Jul 14 14:44:20.546314 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-VolumesActionsTest-1063862574-project Jul 14 14:44:20.546314 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:44:20.546314 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Instance 1538a760-c1f4-4676-bb55-6592d5ca3021 could not be found. Jul 14 14:44:20.546314 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': '1538a760-c1f4-4676-bb55-6592d5ca3021'} Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1538a760-c1f4-4676-bb55-6592d5ca3021 could not be found. Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:44:20.547244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:44:20.549532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:44:20.549532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:44:20.549532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:44:20.549532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:44:20.549532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:44:20.549532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:44:20.549532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:44:20.549532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1538a760-c1f4-4676-bb55-6592d5ca3021 could not be found. Jul 14 14:44:20.549532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:44:20.549532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:20.549532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:44:20.549532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:20.549532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:20.549532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:20.549532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:44:20.549532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:44:20.549532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1538a760-c1f4-4676-bb55-6592d5ca3021 could not be found. Jul 14 14:44:20.549532 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:44:20.550974 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-34b61b93-f0be-4163-a1ca-79b60592bcf8 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Returning 404 to user: Instance 1538a760-c1f4-4676-bb55-6592d5ca3021 could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:44:20.550974 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-34b61b93-f0be-4163-a1ca-79b60592bcf8 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021" status: 404 len: 111 microversion: 2.1 time: 0.030272 Jul 14 14:44:20.550974 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 529/1049] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:20 2022] GET /compute/v2.1/servers/1538a760-c1f4-4676-bb55-6592d5ca3021 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:44:20.594705 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-faa03d53-fbea-4bb6-9778-0cb7e8506171 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2104701909", "imageRef": "7ea875a4-facb-4053-be2d-ff0080d2f3a0", "flavorRef": "452", "networks": [{"uuid": "1081dfe9-22b6-4327-b735-843c4b4f8748"}]}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:20.647095 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.network.neutron [None req-faa03d53-fbea-4bb6-9778-0cb7e8506171 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] validate_networks() for [('1081dfe9-22b6-4327-b735-843c4b4f8748', None, None, None, None, None)] {{(pid=118462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:44:20.988824 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-faa03d53-fbea-4bb6-9778-0cb7e8506171 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Flavor limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:44:20.989239 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-faa03d53-fbea-4bb6-9778-0cb7e8506171 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Image limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:44:20.989709 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-faa03d53-fbea-4bb6-9778-0cb7e8506171 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Flavor pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:44:20.991341 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-faa03d53-fbea-4bb6-9778-0cb7e8506171 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Image pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:44:20.991341 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-faa03d53-fbea-4bb6-9778-0cb7e8506171 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:44:20.999555 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-faa03d53-fbea-4bb6-9778-0cb7e8506171 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:20.999996 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-faa03d53-fbea-4bb6-9778-0cb7e8506171 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:21.000780 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-faa03d53-fbea-4bb6-9778-0cb7e8506171 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:21.001763 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-faa03d53-fbea-4bb6-9778-0cb7e8506171 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:21.018564 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-faa03d53-fbea-4bb6-9778-0cb7e8506171 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Getting quotas for project 39fed467abc64dc4931449d9c332fffe. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:44:21.022379 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-faa03d53-fbea-4bb6-9778-0cb7e8506171 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Getting quotas for user a152b2998ccc45e5b28f952959ac0592 and project 39fed467abc64dc4931449d9c332fffe. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:44:21.033674 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-faa03d53-fbea-4bb6-9778-0cb7e8506171 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Going to run 1 instances... {{(pid=118462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:44:21.036010 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-faa03d53-fbea-4bb6-9778-0cb7e8506171 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: f26c7c94-4c0c-4c40-b296-1a230ae9a193] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7ea875a4-facb-4053-be2d-ff0080d2f3a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:44:21.162949 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-faa03d53-fbea-4bb6-9778-0cb7e8506171 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572348 Jul 14 14:44:21.163624 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 521/1050] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:44:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:44:21.174539 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-aa447054-172c-4191-bac2-fa47c9111aff tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:21.175027 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-aa447054-172c-4191-bac2-fa47c9111aff tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: f26c7c94-4c0c-4c40-b296-1a230ae9a193] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:21.234716 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-aa447054-172c-4191-bac2-fa47c9111aff tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:21.241888 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-aa447054-172c-4191-bac2-fa47c9111aff tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193" status: 200 len: 1214 microversion: 2.1 time: 0.072186 Jul 14 14:44:21.242460 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 530/1051] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:21 2022] GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:22.259397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b1dd9697-23f6-4166-b047-f8bd5bce357e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:22.259995 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b1dd9697-23f6-4166-b047-f8bd5bce357e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: f26c7c94-4c0c-4c40-b296-1a230ae9a193] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:22.269400 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b1dd9697-23f6-4166-b047-f8bd5bce357e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:22.269893 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b1dd9697-23f6-4166-b047-f8bd5bce357e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:22.270664 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b1dd9697-23f6-4166-b047-f8bd5bce357e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:22.271099 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b1dd9697-23f6-4166-b047-f8bd5bce357e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:22.336591 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b1dd9697-23f6-4166-b047-f8bd5bce357e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:22.344333 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b1dd9697-23f6-4166-b047-f8bd5bce357e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193" status: 200 len: 1218 microversion: 2.1 time: 0.089442 Jul 14 14:44:22.344894 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 522/1052] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:22 2022] GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:23.360408 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-de0e93e6-def2-4015-a64d-dfa442733209 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:23.361089 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-de0e93e6-def2-4015-a64d-dfa442733209 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: f26c7c94-4c0c-4c40-b296-1a230ae9a193] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:23.368471 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-de0e93e6-def2-4015-a64d-dfa442733209 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:23.376598 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-de0e93e6-def2-4015-a64d-dfa442733209 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:23.376598 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-de0e93e6-def2-4015-a64d-dfa442733209 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:23.376598 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-de0e93e6-def2-4015-a64d-dfa442733209 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:23.432731 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-de0e93e6-def2-4015-a64d-dfa442733209 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:23.440721 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-de0e93e6-def2-4015-a64d-dfa442733209 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193" status: 200 len: 1284 microversion: 2.1 time: 0.084265 Jul 14 14:44:23.441272 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 531/1053] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:23 2022] GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193 => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:24.458218 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a3624df8-2a27-48f6-8278-240480715cc0 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:24.458876 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a3624df8-2a27-48f6-8278-240480715cc0 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: f26c7c94-4c0c-4c40-b296-1a230ae9a193] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:24.465338 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a3624df8-2a27-48f6-8278-240480715cc0 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:24.466068 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a3624df8-2a27-48f6-8278-240480715cc0 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:24.466831 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a3624df8-2a27-48f6-8278-240480715cc0 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:24.467270 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a3624df8-2a27-48f6-8278-240480715cc0 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:24.613927 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a3624df8-2a27-48f6-8278-240480715cc0 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:24.614232 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a3624df8-2a27-48f6-8278-240480715cc0 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193" status: 200 len: 1314 microversion: 2.1 time: 0.160213 Jul 14 14:44:24.614816 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 523/1054] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:24 2022] GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:24.930710 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-869da329-b196-43c7-8099-c9ca1b10d9fc req-13e2a4cf-ff04-4ac3-8cdc-0f989abbca84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f26c7c94-4c0c-4c40-b296-1a230ae9a193", "tag": "4b92c00a-eed4-451a-b581-5d6b77bba644"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:24.939750 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-869da329-b196-43c7-8099-c9ca1b10d9fc req-13e2a4cf-ff04-4ac3-8cdc-0f989abbca84 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:24.940193 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-869da329-b196-43c7-8099-c9ca1b10d9fc req-13e2a4cf-ff04-4ac3-8cdc-0f989abbca84 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:24.951378 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-869da329-b196-43c7-8099-c9ca1b10d9fc req-13e2a4cf-ff04-4ac3-8cdc-0f989abbca84 service nova] Creating event network-changed:4b92c00a-eed4-451a-b581-5d6b77bba644 for instance f26c7c94-4c0c-4c40-b296-1a230ae9a193 on hv-cinder-79987 Jul 14 14:44:24.956787 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-869da329-b196-43c7-8099-c9ca1b10d9fc req-13e2a4cf-ff04-4ac3-8cdc-0f989abbca84 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029901 Jul 14 14:44:24.957181 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 532/1055] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:25.631311 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b99be985-530d-4c5e-b5bd-530d4baf5a76 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:25.632006 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b99be985-530d-4c5e-b5bd-530d4baf5a76 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: f26c7c94-4c0c-4c40-b296-1a230ae9a193] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:25.637914 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b99be985-530d-4c5e-b5bd-530d4baf5a76 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:25.638378 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b99be985-530d-4c5e-b5bd-530d4baf5a76 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:25.639128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b99be985-530d-4c5e-b5bd-530d4baf5a76 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:25.639600 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b99be985-530d-4c5e-b5bd-530d4baf5a76 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:25.771016 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b99be985-530d-4c5e-b5bd-530d4baf5a76 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:25.778564 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b99be985-530d-4c5e-b5bd-530d4baf5a76 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193" status: 200 len: 1314 microversion: 2.1 time: 0.151304 Jul 14 14:44:25.779153 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 524/1056] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:25 2022] GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:26.797083 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-60c789eb-0e7d-4a50-a13f-dec20a80075a tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:26.797791 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-60c789eb-0e7d-4a50-a13f-dec20a80075a tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: f26c7c94-4c0c-4c40-b296-1a230ae9a193] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:26.803968 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-60c789eb-0e7d-4a50-a13f-dec20a80075a tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:26.804408 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-60c789eb-0e7d-4a50-a13f-dec20a80075a tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:26.805157 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-60c789eb-0e7d-4a50-a13f-dec20a80075a tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:26.805587 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-60c789eb-0e7d-4a50-a13f-dec20a80075a tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:26.933560 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-60c789eb-0e7d-4a50-a13f-dec20a80075a tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:26.940985 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-60c789eb-0e7d-4a50-a13f-dec20a80075a tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193" status: 200 len: 1314 microversion: 2.1 time: 0.148628 Jul 14 14:44:26.941542 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 533/1057] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:26 2022] GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:27.957649 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-fbe3ebae-7304-4eb2-8e10-c2bc4a335f76 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:27.958290 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-fbe3ebae-7304-4eb2-8e10-c2bc4a335f76 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: f26c7c94-4c0c-4c40-b296-1a230ae9a193] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:27.964837 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fbe3ebae-7304-4eb2-8e10-c2bc4a335f76 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:27.965319 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fbe3ebae-7304-4eb2-8e10-c2bc4a335f76 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:27.966358 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fbe3ebae-7304-4eb2-8e10-c2bc4a335f76 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:27.966793 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-fbe3ebae-7304-4eb2-8e10-c2bc4a335f76 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:28.095075 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-fbe3ebae-7304-4eb2-8e10-c2bc4a335f76 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:28.102487 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-fbe3ebae-7304-4eb2-8e10-c2bc4a335f76 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193" status: 200 len: 1314 microversion: 2.1 time: 0.148720 Jul 14 14:44:28.103057 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 525/1058] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:27 2022] GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:29.119798 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-cdd45a93-a817-4c06-b85b-e31dc783019a tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:29.120380 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-cdd45a93-a817-4c06-b85b-e31dc783019a tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: f26c7c94-4c0c-4c40-b296-1a230ae9a193] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:29.122864 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:29.128333 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cdd45a93-a817-4c06-b85b-e31dc783019a tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:29.132686 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cdd45a93-a817-4c06-b85b-e31dc783019a tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:29.132686 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cdd45a93-a817-4c06-b85b-e31dc783019a tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:29.132686 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cdd45a93-a817-4c06-b85b-e31dc783019a tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:29.132686 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=61 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:29.266601 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-cdd45a93-a817-4c06-b85b-e31dc783019a tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:29.274380 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-cdd45a93-a817-4c06-b85b-e31dc783019a tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193" status: 200 len: 1314 microversion: 2.1 time: 0.158463 Jul 14 14:44:29.274960 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 534/1059] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:29 2022] GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:30.292131 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-17a840c0-2099-452b-8b56-c5fc357a72e3 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:30.292745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-17a840c0-2099-452b-8b56-c5fc357a72e3 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: f26c7c94-4c0c-4c40-b296-1a230ae9a193] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:30.299267 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-17a840c0-2099-452b-8b56-c5fc357a72e3 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:30.299710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-17a840c0-2099-452b-8b56-c5fc357a72e3 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:30.300458 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-17a840c0-2099-452b-8b56-c5fc357a72e3 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:30.300885 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-17a840c0-2099-452b-8b56-c5fc357a72e3 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:30.305262 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:30.431722 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-17a840c0-2099-452b-8b56-c5fc357a72e3 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:30.439850 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-17a840c0-2099-452b-8b56-c5fc357a72e3 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193" status: 200 len: 1314 microversion: 2.1 time: 0.151889 Jul 14 14:44:30.440410 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 526/1060] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:30 2022] GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:31.457610 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-190ceff8-ce1f-412b-9531-e9e5cef2d56e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:31.459512 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-190ceff8-ce1f-412b-9531-e9e5cef2d56e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: f26c7c94-4c0c-4c40-b296-1a230ae9a193] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:31.462491 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:31.467639 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-190ceff8-ce1f-412b-9531-e9e5cef2d56e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:31.468124 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-190ceff8-ce1f-412b-9531-e9e5cef2d56e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:31.468867 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-190ceff8-ce1f-412b-9531-e9e5cef2d56e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:31.469298 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-190ceff8-ce1f-412b-9531-e9e5cef2d56e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:31.503355 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-63fce83c-dfb2-47e8-b510-34809876f06f req-9aafaab3-7933-4d41-a1fa-df9d9313ca97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f26c7c94-4c0c-4c40-b296-1a230ae9a193", "name": "network-vif-plugged", "status": "completed", "tag": "4b92c00a-eed4-451a-b581-5d6b77bba644"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:31.507320 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=2 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:31.509020 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=6 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:31.509315 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:31.514900 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-63fce83c-dfb2-47e8-b510-34809876f06f req-9aafaab3-7933-4d41-a1fa-df9d9313ca97 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:31.515339 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-63fce83c-dfb2-47e8-b510-34809876f06f req-9aafaab3-7933-4d41-a1fa-df9d9313ca97 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:31.527215 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-63fce83c-dfb2-47e8-b510-34809876f06f req-9aafaab3-7933-4d41-a1fa-df9d9313ca97 service nova] Creating event network-vif-plugged:4b92c00a-eed4-451a-b581-5d6b77bba644 for instance f26c7c94-4c0c-4c40-b296-1a230ae9a193 on hv-cinder-79987 Jul 14 14:44:31.532276 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-63fce83c-dfb2-47e8-b510-34809876f06f req-9aafaab3-7933-4d41-a1fa-df9d9313ca97 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034508 Jul 14 14:44:31.532885 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 527/1061] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:44:31.606457 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-190ceff8-ce1f-412b-9531-e9e5cef2d56e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:31.614175 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-190ceff8-ce1f-412b-9531-e9e5cef2d56e tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193" status: 200 len: 1314 microversion: 2.1 time: 0.161254 Jul 14 14:44:31.614747 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 535/1062] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:31 2022] GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:32.631838 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c161cf14-365f-4f62-a6fa-8daebea01aee tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:32.632532 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c161cf14-365f-4f62-a6fa-8daebea01aee tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: f26c7c94-4c0c-4c40-b296-1a230ae9a193] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:32.640707 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c161cf14-365f-4f62-a6fa-8daebea01aee tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:32.645193 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c161cf14-365f-4f62-a6fa-8daebea01aee tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:32.645193 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c161cf14-365f-4f62-a6fa-8daebea01aee tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:32.645193 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c161cf14-365f-4f62-a6fa-8daebea01aee tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:32.774899 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-c161cf14-365f-4f62-a6fa-8daebea01aee tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:32.783464 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c161cf14-365f-4f62-a6fa-8daebea01aee tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193" status: 200 len: 1314 microversion: 2.1 time: 0.156219 Jul 14 14:44:32.784036 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 528/1063] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:32 2022] GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:33.801023 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-db904955-cc9f-4034-8a0d-6e900bfb6f3f tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:33.801620 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-db904955-cc9f-4034-8a0d-6e900bfb6f3f tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: f26c7c94-4c0c-4c40-b296-1a230ae9a193] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:33.808068 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-db904955-cc9f-4034-8a0d-6e900bfb6f3f tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:33.808505 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-db904955-cc9f-4034-8a0d-6e900bfb6f3f tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:33.809250 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-db904955-cc9f-4034-8a0d-6e900bfb6f3f tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:33.809674 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-db904955-cc9f-4034-8a0d-6e900bfb6f3f tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:33.942282 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-db904955-cc9f-4034-8a0d-6e900bfb6f3f tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:33.949923 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-db904955-cc9f-4034-8a0d-6e900bfb6f3f tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193" status: 200 len: 1499 microversion: 2.1 time: 0.153592 Jul 14 14:44:33.950585 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 536/1064] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:33 2022] GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193 => generated 1499 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:34.731220 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-121eca63-6cbb-42cf-894d-de3fecdbddb2 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:34.731773 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-121eca63-6cbb-42cf-894d-de3fecdbddb2 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: f26c7c94-4c0c-4c40-b296-1a230ae9a193] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:34.738416 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-121eca63-6cbb-42cf-894d-de3fecdbddb2 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:34.739041 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-121eca63-6cbb-42cf-894d-de3fecdbddb2 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:34.739785 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-121eca63-6cbb-42cf-894d-de3fecdbddb2 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:34.740216 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-121eca63-6cbb-42cf-894d-de3fecdbddb2 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:34.768237 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-121eca63-6cbb-42cf-894d-de3fecdbddb2 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: f26c7c94-4c0c-4c40-b296-1a230ae9a193] Going to try to terminate instance {{(pid=118462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:44:35.086692 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-121eca63-6cbb-42cf-894d-de3fecdbddb2 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "DELETE /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193" status: 204 len: 0 microversion: 2.1 time: 0.359085 Jul 14 14:44:35.087279 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 529/1065] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:44:34 2022] DELETE /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:44:35.095704 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-59332ccd-e947-4d87-8fba-129020e58945 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:35.101934 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-59332ccd-e947-4d87-8fba-129020e58945 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: f26c7c94-4c0c-4c40-b296-1a230ae9a193] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:35.102954 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-59332ccd-e947-4d87-8fba-129020e58945 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:35.103403 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-59332ccd-e947-4d87-8fba-129020e58945 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:35.104165 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-59332ccd-e947-4d87-8fba-129020e58945 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:35.104597 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-59332ccd-e947-4d87-8fba-129020e58945 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:35.231853 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-59332ccd-e947-4d87-8fba-129020e58945 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:35.240158 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-59332ccd-e947-4d87-8fba-129020e58945 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193" status: 200 len: 1505 microversion: 2.1 time: 0.148360 Jul 14 14:44:35.240756 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 537/1066] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:35 2022] GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:36.258093 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-548973a8-ab8d-4998-ab6b-40f29d622802 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:36.258827 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-548973a8-ab8d-4998-ab6b-40f29d622802 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: f26c7c94-4c0c-4c40-b296-1a230ae9a193] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:36.265355 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-548973a8-ab8d-4998-ab6b-40f29d622802 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:36.265828 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-548973a8-ab8d-4998-ab6b-40f29d622802 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:36.267218 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-548973a8-ab8d-4998-ab6b-40f29d622802 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:36.267654 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-548973a8-ab8d-4998-ab6b-40f29d622802 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:36.395346 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-548973a8-ab8d-4998-ab6b-40f29d622802 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:36.403173 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-548973a8-ab8d-4998-ab6b-40f29d622802 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193" status: 200 len: 1505 microversion: 2.1 time: 0.149422 Jul 14 14:44:36.403745 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 530/1067] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:36 2022] GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:36.941724 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-a4b2f6ad-5dab-4022-95e1-f5746739159b req-577219b7-78f7-45de-95b8-76c2cc1445a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f26c7c94-4c0c-4c40-b296-1a230ae9a193", "name": "network-vif-deleted", "tag": "4b92c00a-eed4-451a-b581-5d6b77bba644"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:36.950335 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-a4b2f6ad-5dab-4022-95e1-f5746739159b req-577219b7-78f7-45de-95b8-76c2cc1445a2 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:36.952475 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-a4b2f6ad-5dab-4022-95e1-f5746739159b req-577219b7-78f7-45de-95b8-76c2cc1445a2 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:36.962607 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-a4b2f6ad-5dab-4022-95e1-f5746739159b req-577219b7-78f7-45de-95b8-76c2cc1445a2 service nova] Creating event network-vif-deleted:4b92c00a-eed4-451a-b581-5d6b77bba644 for instance f26c7c94-4c0c-4c40-b296-1a230ae9a193 on hv-cinder-79987 Jul 14 14:44:36.967949 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-a4b2f6ad-5dab-4022-95e1-f5746739159b req-577219b7-78f7-45de-95b8-76c2cc1445a2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030414 Jul 14 14:44:36.968538 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 538/1068] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:37.420735 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-07f1f50f-737a-480b-9b1c-273eddf5cc07 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:37.421350 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-07f1f50f-737a-480b-9b1c-273eddf5cc07 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: f26c7c94-4c0c-4c40-b296-1a230ae9a193] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:37.427828 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-07f1f50f-737a-480b-9b1c-273eddf5cc07 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:37.428268 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-07f1f50f-737a-480b-9b1c-273eddf5cc07 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:37.429021 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-07f1f50f-737a-480b-9b1c-273eddf5cc07 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:37.429490 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-07f1f50f-737a-480b-9b1c-273eddf5cc07 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:37.482949 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-07f1f50f-737a-480b-9b1c-273eddf5cc07 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:37.483562 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-07f1f50f-737a-480b-9b1c-273eddf5cc07 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:37.484196 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.objects.instance [None req-07f1f50f-737a-480b-9b1c-273eddf5cc07 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lazy-loading 'fault' on Instance uuid f26c7c94-4c0c-4c40-b296-1a230ae9a193 {{(pid=118462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:44:37.544176 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-07f1f50f-737a-480b-9b1c-273eddf5cc07 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a152b2998ccc45e5b28f952959ac0592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39fed467abc64dc4931449d9c332fffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:37.552806 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-07f1f50f-737a-480b-9b1c-273eddf5cc07 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193" status: 200 len: 1304 microversion: 2.1 time: 0.136128 Jul 14 14:44:37.556976 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 531/1069] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:37 2022] GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193 => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:38.571439 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e7426531-0eb1-4528-8832-2cf01e05a9d4 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:38.572155 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-e7426531-0eb1-4528-8832-2cf01e05a9d4 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] [instance: f26c7c94-4c0c-4c40-b296-1a230ae9a193] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:38.578473 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e7426531-0eb1-4528-8832-2cf01e05a9d4 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:38.578925 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e7426531-0eb1-4528-8832-2cf01e05a9d4 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:38.579684 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e7426531-0eb1-4528-8832-2cf01e05a9d4 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:38.580112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-e7426531-0eb1-4528-8832-2cf01e05a9d4 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:38.594016 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-e7426531-0eb1-4528-8832-2cf01e05a9d4 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] HTTP exception thrown: Instance f26c7c94-4c0c-4c40-b296-1a230ae9a193 could not be found. Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e7426531-0eb1-4528-8832-2cf01e05a9d4 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Request method failure captured: Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193 HTTP/1.1 Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0CurNA_TWvAkui6BDEujIez19t1eh8zZa_Iy_UHwd7XXoCkk4U83lwrHMlwxCtfd7BhbvkI3HpE9GoB4sWmDbAhBQ6PCZTbU5HMs3OlK8AoPZzfhySanybThlLL4aC7xr28ezYAgrDokQ0DmC5xdSR_Jmx8n7CI8hQxpPBBNsjW4pVU Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: 39fed467abc64dc4931449d9c332fffe Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-VolumesActionsTest-1063862574 Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:44:38.595682 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:44:38.597231 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_39fed467abc64dc4931449d9c332fffe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39fed467abc64dc4931449d9c332fffe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/39fed467abc64dc4931449d9c332fffe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/39fed467abc64dc4931449d9c332fffe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:44:38.597231 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-VolumesActionsTest-1063862574 Jul 14 14:44:38.597231 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: 39fed467abc64dc4931449d9c332fffe Jul 14 14:44:38.597231 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-VolumesActionsTest-1063862574 Jul 14 14:44:38.597231 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-VolumesActionsTest-1063862574-project Jul 14 14:44:38.597231 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:44:38.597231 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:44:38.597231 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: a152b2998ccc45e5b28f952959ac0592 Jul 14 14:44:38.597231 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-VolumesActionsTest-1063862574-project Jul 14 14:44:38.597231 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:44:38.597231 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Instance f26c7c94-4c0c-4c40-b296-1a230ae9a193 could not be found. Jul 14 14:44:38.597231 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': 'f26c7c94-4c0c-4c40-b296-1a230ae9a193'} Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f26c7c94-4c0c-4c40-b296-1a230ae9a193 could not be found. Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:44:38.598162 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:44:38.600214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:44:38.600214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:44:38.600214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:44:38.600214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:44:38.600214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:44:38.600214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:44:38.600214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:44:38.600214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f26c7c94-4c0c-4c40-b296-1a230ae9a193 could not be found. Jul 14 14:44:38.600214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:44:38.600214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:38.600214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:44:38.600214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:38.600214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:38.600214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:38.600214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:44:38.600214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:44:38.600214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f26c7c94-4c0c-4c40-b296-1a230ae9a193 could not be found. Jul 14 14:44:38.600214 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:44:38.601849 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-e7426531-0eb1-4528-8832-2cf01e05a9d4 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] Returning 404 to user: Instance f26c7c94-4c0c-4c40-b296-1a230ae9a193 could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:44:38.601849 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-e7426531-0eb1-4528-8832-2cf01e05a9d4 tempest-VolumesActionsTest-1063862574 tempest-VolumesActionsTest-1063862574-project] 10.222.0.93 "GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193" status: 404 len: 111 microversion: 2.1 time: 0.030444 Jul 14 14:44:38.601849 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 539/1070] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:38 2022] GET /compute/v2.1/servers/f26c7c94-4c0c-4c40-b296-1a230ae9a193 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:45:30.133119 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-802596c6-0d9a-4a26-a250-60866ca51f3d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:30.133744 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-802596c6-0d9a-4a26-a250-60866ca51f3d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:30.135768 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:30.136585 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:30.141598 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-802596c6-0d9a-4a26-a250-60866ca51f3d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.141804 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-802596c6-0d9a-4a26-a250-60866ca51f3d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.142557 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-802596c6-0d9a-4a26-a250-60866ca51f3d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.142983 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-802596c6-0d9a-4a26-a250-60866ca51f3d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.167629 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-802596c6-0d9a-4a26-a250-60866ca51f3d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Going to try to terminate instance {{(pid=118462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:45:30.559329 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-802596c6-0d9a-4a26-a250-60866ca51f3d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 204 len: 0 microversion: 2.1 time: 0.430104 Jul 14 14:45:30.560003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 532/1071] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:45:30 2022] DELETE /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:45:30.569145 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-334270ff-3a48-4792-9ac2-ae1ffa7c7be4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:30.570412 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-334270ff-3a48-4792-9ac2-ae1ffa7c7be4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:30.572836 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=11 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:30.573496 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=27 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:30.578428 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-334270ff-3a48-4792-9ac2-ae1ffa7c7be4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.579595 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-334270ff-3a48-4792-9ac2-ae1ffa7c7be4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.580426 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-334270ff-3a48-4792-9ac2-ae1ffa7c7be4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.580900 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-334270ff-3a48-4792-9ac2-ae1ffa7c7be4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.712457 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-334270ff-3a48-4792-9ac2-ae1ffa7c7be4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:30.720251 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-334270ff-3a48-4792-9ac2-ae1ffa7c7be4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1574 microversion: 2.1 time: 0.155376 Jul 14 14:45:30.732983 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 540/1072] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:30 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:31.738057 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-adcec4c2-7786-4295-aab4-5ba170202c1d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:31.738787 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-adcec4c2-7786-4295-aab4-5ba170202c1d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:31.745324 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-adcec4c2-7786-4295-aab4-5ba170202c1d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:31.745789 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-adcec4c2-7786-4295-aab4-5ba170202c1d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:31.746555 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-adcec4c2-7786-4295-aab4-5ba170202c1d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:31.746989 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-adcec4c2-7786-4295-aab4-5ba170202c1d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:31.877612 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-adcec4c2-7786-4295-aab4-5ba170202c1d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:31.885161 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-adcec4c2-7786-4295-aab4-5ba170202c1d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1574 microversion: 2.1 time: 0.151691 Jul 14 14:45:31.885725 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 533/1073] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:31 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:32.903696 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-8f096b16-95f5-4534-82bc-ee782b5ee885 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:32.904312 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-8f096b16-95f5-4534-82bc-ee782b5ee885 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:32.911439 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8f096b16-95f5-4534-82bc-ee782b5ee885 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:32.914161 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8f096b16-95f5-4534-82bc-ee782b5ee885 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:32.914161 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8f096b16-95f5-4534-82bc-ee782b5ee885 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:32.914161 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8f096b16-95f5-4534-82bc-ee782b5ee885 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:32.987189 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-8f096b16-95f5-4534-82bc-ee782b5ee885 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:32.994853 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-8f096b16-95f5-4534-82bc-ee782b5ee885 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1507 microversion: 2.1 time: 0.095852 Jul 14 14:45:33.000372 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 541/1074] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:32 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1507 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:33.253387 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-ea1cc9a0-6e89-4143-b69e-ebf5cd977a13 req-ad56f512-984f-4c72-aee9-9be7fd4ff87b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1cd5a3-6756-4243-9e5c-452d92bc8a09", "name": "network-vif-deleted", "tag": "239ed8a3-d717-491c-ba96-59229a3802d1"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:33.262621 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-ea1cc9a0-6e89-4143-b69e-ebf5cd977a13 req-ad56f512-984f-4c72-aee9-9be7fd4ff87b service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:33.263056 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-ea1cc9a0-6e89-4143-b69e-ebf5cd977a13 req-ad56f512-984f-4c72-aee9-9be7fd4ff87b service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:33.274374 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-ea1cc9a0-6e89-4143-b69e-ebf5cd977a13 req-ad56f512-984f-4c72-aee9-9be7fd4ff87b service nova] Creating event network-vif-deleted:239ed8a3-d717-491c-ba96-59229a3802d1 for instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 on hv-cinder-79987 Jul 14 14:45:33.279391 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-ea1cc9a0-6e89-4143-b69e-ebf5cd977a13 req-ad56f512-984f-4c72-aee9-9be7fd4ff87b service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030994 Jul 14 14:45:33.280516 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 534/1075] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:34.012731 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-7d450d96-46a4-4f80-857e-e0bffbf209a0 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:34.013522 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-7d450d96-46a4-4f80-857e-e0bffbf209a0 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:34.020870 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7d450d96-46a4-4f80-857e-e0bffbf209a0 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:34.021353 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7d450d96-46a4-4f80-857e-e0bffbf209a0 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:34.022098 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7d450d96-46a4-4f80-857e-e0bffbf209a0 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:34.022544 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7d450d96-46a4-4f80-857e-e0bffbf209a0 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:34.057918 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7d450d96-46a4-4f80-857e-e0bffbf209a0 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:34.058511 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7d450d96-46a4-4f80-857e-e0bffbf209a0 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:34.059061 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.objects.instance [None req-7d450d96-46a4-4f80-857e-e0bffbf209a0 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lazy-loading 'fault' on Instance uuid 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 {{(pid=118461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:45:34.104821 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7d450d96-46a4-4f80-857e-e0bffbf209a0 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:34.113123 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-7d450d96-46a4-4f80-857e-e0bffbf209a0 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 200 len: 1230 microversion: 2.1 time: 0.104509 Jul 14 14:45:34.113702 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 542/1076] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:34 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:35.131786 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-935eba9e-2344-4ee1-ba89-92828ed60d1f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:35.132403 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-935eba9e-2344-4ee1-ba89-92828ed60d1f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:35.139092 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-935eba9e-2344-4ee1-ba89-92828ed60d1f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:35.139540 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-935eba9e-2344-4ee1-ba89-92828ed60d1f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:35.140334 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-935eba9e-2344-4ee1-ba89-92828ed60d1f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:35.140779 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-935eba9e-2344-4ee1-ba89-92828ed60d1f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:35.156443 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-935eba9e-2344-4ee1-ba89-92828ed60d1f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] HTTP exception thrown: Instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 could not be found. Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-935eba9e-2344-4ee1-ba89-92828ed60d1f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Request method failure captured: Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 HTTP/1.1 Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0Ctf5O4f2gkpIGOKzWxJuIypHGw1QlZSpAqBd5SNTZTt7YXJhBmupYGjRryobS0yPHCYoN25mIXbfTmIDlYpak9SzJaCYPRZaEPIA5Y1WNAIVo8MTS39MUHo9BGTOOw9j1byz7gsr6uvYtWS5LOoclcXbmoYg6WHF4yJ8Yx8IUBoWVA Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: 4c597b767cad4ce288fa65d68c5eaff5 Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-TestVolumeBootPattern-624950949 Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:45:35.158189 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:45:35.159883 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:45:35.159883 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-TestVolumeBootPattern-624950949 Jul 14 14:45:35.159883 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: 4c597b767cad4ce288fa65d68c5eaff5 Jul 14 14:45:35.159883 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-TestVolumeBootPattern-624950949 Jul 14 14:45:35.159883 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-TestVolumeBootPattern-624950949-project Jul 14 14:45:35.159883 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:45:35.159883 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:45:35.159883 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 79cca3fb8e6840e688fddecdbce20f1c Jul 14 14:45:35.159883 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-TestVolumeBootPattern-624950949-project Jul 14 14:45:35.159883 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:45:35.159883 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 could not be found. Jul 14 14:45:35.159883 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '3c1cd5a3-6756-4243-9e5c-452d92bc8a09'} Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 could not be found. Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:45:35.160957 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:45:35.162666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:45:35.162666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:45:35.162666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:45:35.162666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:45:35.162666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:45:35.162666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:45:35.162666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:45:35.162666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 could not be found. Jul 14 14:45:35.162666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:45:35.162666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:35.162666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:45:35.162666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:35.162666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:35.162666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:35.162666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:45:35.162666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:45:35.162666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 could not be found. Jul 14 14:45:35.162666 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:45:35.164138 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-935eba9e-2344-4ee1-ba89-92828ed60d1f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Returning 404 to user: Instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:45:35.164138 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-935eba9e-2344-4ee1-ba89-92828ed60d1f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 404 len: 111 microversion: 2.1 time: 0.033375 Jul 14 14:45:35.164138 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 535/1077] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:35 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:45:35.255674 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-8ce099c8-5128-4b38-a9cf-87db95c15f61 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-70841673", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-503334875", "security_groups": [{"name": "tempest-secgroup-smoke-633283655"}], "block_device_mapping_v2": [{"uuid": "ba3ff010-a20d-4824-9626-74aed761a847", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c6e7ee75-56fd-433e-9d2e-334d21d9fbeb"}]}} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:35.378135 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.network.neutron [None req-8ce099c8-5128-4b38-a9cf-87db95c15f61 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] validate_networks() for [('c6e7ee75-56fd-433e-9d2e-334d21d9fbeb', None, None, None, None, None)] {{(pid=118461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:45:35.739440 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-8ce099c8-5128-4b38-a9cf-87db95c15f61 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Flavor limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:45:35.739854 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-8ce099c8-5128-4b38-a9cf-87db95c15f61 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Image limits 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:45:35.740316 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-8ce099c8-5128-4b38-a9cf-87db95c15f61 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Flavor pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:45:35.740719 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-8ce099c8-5128-4b38-a9cf-87db95c15f61 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Image pref 0:0:0 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:45:35.741117 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.virt.hardware [None req-8ce099c8-5128-4b38-a9cf-87db95c15f61 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:45:35.749953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8ce099c8-5128-4b38-a9cf-87db95c15f61 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:35.750390 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8ce099c8-5128-4b38-a9cf-87db95c15f61 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:35.751171 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8ce099c8-5128-4b38-a9cf-87db95c15f61 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:35.751595 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-8ce099c8-5128-4b38-a9cf-87db95c15f61 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:35.767730 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-8ce099c8-5128-4b38-a9cf-87db95c15f61 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Getting quotas for project 4c597b767cad4ce288fa65d68c5eaff5. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:45:35.771601 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.quota [None req-8ce099c8-5128-4b38-a9cf-87db95c15f61 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Getting quotas for user 79cca3fb8e6840e688fddecdbce20f1c and project 4c597b767cad4ce288fa65d68c5eaff5. Resources: {'ram', 'instances', 'cores'} {{(pid=118461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:45:35.831320 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-8ce099c8-5128-4b38-a9cf-87db95c15f61 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Going to run 1 instances... {{(pid=118461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:45:35.831320 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-8ce099c8-5128-4b38-a9cf-87db95c15f61 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ba3ff010-a20d-4824-9626-74aed761a847',volume_size=None,volume_type=None)] {{(pid=118461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:45:36.258393 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-8ce099c8-5128-4b38-a9cf-87db95c15f61 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.007236 Jul 14 14:45:36.259216 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 543/1078] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:45:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:45:36.269291 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-515918e6-66a0-4568-96b2-4a2336820e0b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:36.269956 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-515918e6-66a0-4568-96b2-4a2336820e0b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:36.325499 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-515918e6-66a0-4568-96b2-4a2336820e0b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:36.335700 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-515918e6-66a0-4568-96b2-4a2336820e0b tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 200 len: 1092 microversion: 2.1 time: 0.070388 Jul 14 14:45:36.345076 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 536/1079] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:36 2022] GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 1092 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:37.353974 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-54e7c153-20b4-4bc1-84c6-4437c51ce38e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:37.354723 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-54e7c153-20b4-4bc1-84c6-4437c51ce38e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:37.368635 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-54e7c153-20b4-4bc1-84c6-4437c51ce38e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:37.368635 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-54e7c153-20b4-4bc1-84c6-4437c51ce38e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:37.368635 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-54e7c153-20b4-4bc1-84c6-4437c51ce38e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:37.368635 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-54e7c153-20b4-4bc1-84c6-4437c51ce38e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:37.429582 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-54e7c153-20b4-4bc1-84c6-4437c51ce38e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:37.437286 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-54e7c153-20b4-4bc1-84c6-4437c51ce38e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 200 len: 1134 microversion: 2.1 time: 0.088186 Jul 14 14:45:37.438753 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 544/1080] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:37 2022] GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 1134 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:38.454545 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-1d2d23a5-4f59-4d03-89af-a10fcb5dc922 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:38.455233 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-1d2d23a5-4f59-4d03-89af-a10fcb5dc922 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:38.462032 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1d2d23a5-4f59-4d03-89af-a10fcb5dc922 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.462557 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1d2d23a5-4f59-4d03-89af-a10fcb5dc922 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:38.463659 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1d2d23a5-4f59-4d03-89af-a10fcb5dc922 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.464165 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1d2d23a5-4f59-4d03-89af-a10fcb5dc922 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:38.526431 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-1d2d23a5-4f59-4d03-89af-a10fcb5dc922 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:38.534425 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-1d2d23a5-4f59-4d03-89af-a10fcb5dc922 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 200 len: 1208 microversion: 2.1 time: 0.083739 Jul 14 14:45:38.535315 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 537/1081] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:38 2022] GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 1208 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:39.553098 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-c980b6d3-b141-4319-852e-1a9cfbefd57d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:39.554096 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-c980b6d3-b141-4319-852e-1a9cfbefd57d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:39.560895 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c980b6d3-b141-4319-852e-1a9cfbefd57d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:39.561445 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c980b6d3-b141-4319-852e-1a9cfbefd57d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:39.562370 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c980b6d3-b141-4319-852e-1a9cfbefd57d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:39.562920 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-c980b6d3-b141-4319-852e-1a9cfbefd57d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:39.699721 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-c980b6d3-b141-4319-852e-1a9cfbefd57d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:39.708211 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-c980b6d3-b141-4319-852e-1a9cfbefd57d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 200 len: 1263 microversion: 2.1 time: 0.160435 Jul 14 14:45:39.709029 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 545/1082] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:39 2022] GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:39.729589 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-f7fa946b-27aa-4eac-a4d6-b14943ea7710 req-6f7f5d5b-47f1-4d4e-9332-e6e3a7d9fdd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98e910d5-d587-4a9c-89eb-90c2bc660aa4", "tag": "9b90d953-cb8d-4913-b04b-2b2afacd65fd"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:39.739086 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-f7fa946b-27aa-4eac-a4d6-b14943ea7710 req-6f7f5d5b-47f1-4d4e-9332-e6e3a7d9fdd8 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:39.739528 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-f7fa946b-27aa-4eac-a4d6-b14943ea7710 req-6f7f5d5b-47f1-4d4e-9332-e6e3a7d9fdd8 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:39.751211 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-f7fa946b-27aa-4eac-a4d6-b14943ea7710 req-6f7f5d5b-47f1-4d4e-9332-e6e3a7d9fdd8 service nova] Creating event network-changed:9b90d953-cb8d-4913-b04b-2b2afacd65fd for instance 98e910d5-d587-4a9c-89eb-90c2bc660aa4 on hv-cinder-79987 Jul 14 14:45:39.756998 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-f7fa946b-27aa-4eac-a4d6-b14943ea7710 req-6f7f5d5b-47f1-4d4e-9332-e6e3a7d9fdd8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031155 Jul 14 14:45:39.757599 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 538/1083] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:40.726399 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-1f92d7cb-7920-47d7-868b-5e39e967a7d9 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:40.726980 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-1f92d7cb-7920-47d7-868b-5e39e967a7d9 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:40.733499 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1f92d7cb-7920-47d7-868b-5e39e967a7d9 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:40.733977 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1f92d7cb-7920-47d7-868b-5e39e967a7d9 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:40.734740 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1f92d7cb-7920-47d7-868b-5e39e967a7d9 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:40.735176 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1f92d7cb-7920-47d7-868b-5e39e967a7d9 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:41.027233 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-1f92d7cb-7920-47d7-868b-5e39e967a7d9 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:41.035283 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-1f92d7cb-7920-47d7-868b-5e39e967a7d9 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 200 len: 1263 microversion: 2.1 time: 0.312920 Jul 14 14:45:41.035842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 546/1084] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:40 2022] GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 1263 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:42.053631 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-7369d0c2-0e07-47c4-8f38-371687b1a027 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:42.054340 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-7369d0c2-0e07-47c4-8f38-371687b1a027 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:42.060563 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7369d0c2-0e07-47c4-8f38-371687b1a027 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:42.061000 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7369d0c2-0e07-47c4-8f38-371687b1a027 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:42.061777 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7369d0c2-0e07-47c4-8f38-371687b1a027 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:42.062322 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-7369d0c2-0e07-47c4-8f38-371687b1a027 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:42.247640 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-7369d0c2-0e07-47c4-8f38-371687b1a027 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:42.255744 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-7369d0c2-0e07-47c4-8f38-371687b1a027 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 200 len: 1263 microversion: 2.1 time: 0.207431 Jul 14 14:45:42.256302 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 539/1085] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:42 2022] GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 1263 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:43.272902 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-cb87e98e-8d87-410f-90f4-7c091fac402e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:43.273508 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-cb87e98e-8d87-410f-90f4-7c091fac402e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:43.279837 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cb87e98e-8d87-410f-90f4-7c091fac402e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:43.280248 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cb87e98e-8d87-410f-90f4-7c091fac402e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:43.281014 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cb87e98e-8d87-410f-90f4-7c091fac402e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:43.281451 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cb87e98e-8d87-410f-90f4-7c091fac402e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:43.423099 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-cb87e98e-8d87-410f-90f4-7c091fac402e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:43.430648 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-cb87e98e-8d87-410f-90f4-7c091fac402e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 200 len: 1263 microversion: 2.1 time: 0.161647 Jul 14 14:45:43.431212 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 547/1086] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:43 2022] GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:44.447822 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-595a6919-3a1d-4ff7-9c6f-04bad4d907bb tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:44.448372 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-595a6919-3a1d-4ff7-9c6f-04bad4d907bb tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:44.455030 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-595a6919-3a1d-4ff7-9c6f-04bad4d907bb tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:44.455471 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-595a6919-3a1d-4ff7-9c6f-04bad4d907bb tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.456274 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-595a6919-3a1d-4ff7-9c6f-04bad4d907bb tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:44.456704 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-595a6919-3a1d-4ff7-9c6f-04bad4d907bb tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.591452 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-595a6919-3a1d-4ff7-9c6f-04bad4d907bb tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:44.599507 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-595a6919-3a1d-4ff7-9c6f-04bad4d907bb tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 200 len: 1263 microversion: 2.1 time: 0.155671 Jul 14 14:45:44.600072 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 540/1087] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:44 2022] GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:45.616563 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-186c3ed9-7725-4989-8808-4452caf45e66 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:45.617170 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-186c3ed9-7725-4989-8808-4452caf45e66 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:45.624166 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-186c3ed9-7725-4989-8808-4452caf45e66 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:45.624655 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-186c3ed9-7725-4989-8808-4452caf45e66 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:45.625557 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-186c3ed9-7725-4989-8808-4452caf45e66 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:45.626085 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-186c3ed9-7725-4989-8808-4452caf45e66 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:45.755251 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-186c3ed9-7725-4989-8808-4452caf45e66 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:45.758684 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:45.763112 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-186c3ed9-7725-4989-8808-4452caf45e66 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 200 len: 1263 microversion: 2.1 time: 0.150606 Jul 14 14:45:45.763677 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 548/1088] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:45 2022] GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:46.779722 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-d514c0d8-4bd8-4438-87d1-f57cee7a9377 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:46.780323 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-d514c0d8-4bd8-4438-87d1-f57cee7a9377 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:46.782742 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=2 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:46.788166 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d514c0d8-4bd8-4438-87d1-f57cee7a9377 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.788615 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d514c0d8-4bd8-4438-87d1-f57cee7a9377 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.789362 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d514c0d8-4bd8-4438-87d1-f57cee7a9377 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.789844 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-d514c0d8-4bd8-4438-87d1-f57cee7a9377 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.932119 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-d514c0d8-4bd8-4438-87d1-f57cee7a9377 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:46.939706 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-d514c0d8-4bd8-4438-87d1-f57cee7a9377 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 200 len: 1263 microversion: 2.1 time: 0.163966 Jul 14 14:45:46.940770 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 541/1089] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:46 2022] GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:47.957032 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-425ad1ff-27ee-4522-962c-f6e7e9df6a6c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:47.957568 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-425ad1ff-27ee-4522-962c-f6e7e9df6a6c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:47.960628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=6 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:47.966197 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-425ad1ff-27ee-4522-962c-f6e7e9df6a6c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:47.966645 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-425ad1ff-27ee-4522-962c-f6e7e9df6a6c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:47.970405 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-425ad1ff-27ee-4522-962c-f6e7e9df6a6c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:47.970405 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-425ad1ff-27ee-4522-962c-f6e7e9df6a6c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:48.103405 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-425ad1ff-27ee-4522-962c-f6e7e9df6a6c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:48.111495 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-425ad1ff-27ee-4522-962c-f6e7e9df6a6c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 200 len: 1263 microversion: 2.1 time: 0.158910 Jul 14 14:45:48.112073 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 549/1090] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:47 2022] GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:49.128945 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-9a4eacaf-9d06-4c0f-8f67-5ceec4d309c3 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:49.129545 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-9a4eacaf-9d06-4c0f-8f67-5ceec4d309c3 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:49.136323 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9a4eacaf-9d06-4c0f-8f67-5ceec4d309c3 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:49.136805 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9a4eacaf-9d06-4c0f-8f67-5ceec4d309c3 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:49.137550 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9a4eacaf-9d06-4c0f-8f67-5ceec4d309c3 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:49.138338 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-9a4eacaf-9d06-4c0f-8f67-5ceec4d309c3 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:49.269671 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-9a4eacaf-9d06-4c0f-8f67-5ceec4d309c3 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:49.277340 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-9a4eacaf-9d06-4c0f-8f67-5ceec4d309c3 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 200 len: 1263 microversion: 2.1 time: 0.153001 Jul 14 14:45:49.277869 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 542/1091] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:49 2022] GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:49.888329 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-c86722a4-6204-4e57-b36d-59ec2d671242 req-1bd77a56-e18b-44f9-b771-949e868386a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98e910d5-d587-4a9c-89eb-90c2bc660aa4", "name": "network-vif-plugged", "status": "completed", "tag": "9b90d953-cb8d-4913-b04b-2b2afacd65fd"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:49.897537 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-c86722a4-6204-4e57-b36d-59ec2d671242 req-1bd77a56-e18b-44f9-b771-949e868386a2 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:49.898017 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-c86722a4-6204-4e57-b36d-59ec2d671242 req-1bd77a56-e18b-44f9-b771-949e868386a2 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:49.909185 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-c86722a4-6204-4e57-b36d-59ec2d671242 req-1bd77a56-e18b-44f9-b771-949e868386a2 service nova] Creating event network-vif-plugged:9b90d953-cb8d-4913-b04b-2b2afacd65fd for instance 98e910d5-d587-4a9c-89eb-90c2bc660aa4 on hv-cinder-79987 Jul 14 14:45:49.914379 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-c86722a4-6204-4e57-b36d-59ec2d671242 req-1bd77a56-e18b-44f9-b771-949e868386a2 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029758 Jul 14 14:45:49.914964 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 550/1092] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:50.296148 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a49b2772-7855-46b7-9147-d7fd782047fa tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:50.296148 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a49b2772-7855-46b7-9147-d7fd782047fa tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:50.301906 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a49b2772-7855-46b7-9147-d7fd782047fa tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:50.302355 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a49b2772-7855-46b7-9147-d7fd782047fa tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:50.303127 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a49b2772-7855-46b7-9147-d7fd782047fa tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:50.303559 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a49b2772-7855-46b7-9147-d7fd782047fa tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:50.442131 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a49b2772-7855-46b7-9147-d7fd782047fa tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:50.450012 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a49b2772-7855-46b7-9147-d7fd782047fa tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 200 len: 1263 microversion: 2.1 time: 0.159477 Jul 14 14:45:50.453691 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 543/1093] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:50 2022] GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:51.468179 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-b8302eba-1b02-4b9a-9e15-113435724063 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:51.468868 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-b8302eba-1b02-4b9a-9e15-113435724063 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:51.475842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b8302eba-1b02-4b9a-9e15-113435724063 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.476289 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b8302eba-1b02-4b9a-9e15-113435724063 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.477046 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b8302eba-1b02-4b9a-9e15-113435724063 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.477474 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-b8302eba-1b02-4b9a-9e15-113435724063 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.624636 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-b8302eba-1b02-4b9a-9e15-113435724063 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:51.632880 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-b8302eba-1b02-4b9a-9e15-113435724063 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 200 len: 1448 microversion: 2.1 time: 0.169356 Jul 14 14:45:51.633451 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 551/1094] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:51 2022] GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 1448 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:51.650076 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f2ca3ad8-d76a-4329-864f-651b2828e8cc tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:51.650660 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f2ca3ad8-d76a-4329-864f-651b2828e8cc tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:51.657194 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f2ca3ad8-d76a-4329-864f-651b2828e8cc tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.657631 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f2ca3ad8-d76a-4329-864f-651b2828e8cc tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.658434 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f2ca3ad8-d76a-4329-864f-651b2828e8cc tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.658866 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f2ca3ad8-d76a-4329-864f-651b2828e8cc tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.798355 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f2ca3ad8-d76a-4329-864f-651b2828e8cc tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:51.807480 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f2ca3ad8-d76a-4329-864f-651b2828e8cc tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 200 len: 1448 microversion: 2.1 time: 0.161283 Jul 14 14:45:51.808151 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 544/1095] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:51 2022] GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 1448 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:54.036787 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-a986222c-80d6-48ed-beb6-c6e0870087bb req-aed704ef-6c57-45d4-a4bc-43d78b2687e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98e910d5-d587-4a9c-89eb-90c2bc660aa4", "tag": "9b90d953-cb8d-4913-b04b-2b2afacd65fd"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:54.045929 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-a986222c-80d6-48ed-beb6-c6e0870087bb req-aed704ef-6c57-45d4-a4bc-43d78b2687e6 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:54.046288 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-a986222c-80d6-48ed-beb6-c6e0870087bb req-aed704ef-6c57-45d4-a4bc-43d78b2687e6 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:54.058175 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-a986222c-80d6-48ed-beb6-c6e0870087bb req-aed704ef-6c57-45d4-a4bc-43d78b2687e6 service nova] Creating event network-changed:9b90d953-cb8d-4913-b04b-2b2afacd65fd for instance 98e910d5-d587-4a9c-89eb-90c2bc660aa4 on hv-cinder-79987 Jul 14 14:45:54.063699 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-a986222c-80d6-48ed-beb6-c6e0870087bb req-aed704ef-6c57-45d4-a4bc-43d78b2687e6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031130 Jul 14 14:45:54.064704 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 552/1096] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:56.129342 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 14:45:56.130078 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Thu Jul 14 14:45:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 14:47:22.799870 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 14:47:22.800575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Thu Jul 14 14:47:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 14:47:33.532015 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 14:47:33.533918 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Thu Jul 14 14:47:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 14:47:34.757614 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:34.761272 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:34.763722 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-16765887-052f-4ccd-ad94-1a7d775adf3c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-547026037", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-503334875", "security_groups": [{"name": "tempest-secgroup-smoke-633283655"}], "block_device_mapping_v2": [{"uuid": "b1ad720b-1d5d-434b-91d8-772162361cd6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c6e7ee75-56fd-433e-9d2e-334d21d9fbeb"}]}} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:34.889638 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.network.neutron [None req-16765887-052f-4ccd-ad94-1a7d775adf3c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] validate_networks() for [('c6e7ee75-56fd-433e-9d2e-334d21d9fbeb', None, None, None, None, None)] {{(pid=118462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:47:35.319544 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-16765887-052f-4ccd-ad94-1a7d775adf3c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Flavor limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:47:35.319544 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-16765887-052f-4ccd-ad94-1a7d775adf3c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Image limits 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:47:35.319544 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-16765887-052f-4ccd-ad94-1a7d775adf3c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Flavor pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:47:35.319544 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-16765887-052f-4ccd-ad94-1a7d775adf3c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Image pref 0:0:0 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:47:35.319544 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.virt.hardware [None req-16765887-052f-4ccd-ad94-1a7d775adf3c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:47:35.321322 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-16765887-052f-4ccd-ad94-1a7d775adf3c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:35.321788 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-16765887-052f-4ccd-ad94-1a7d775adf3c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:35.322921 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-16765887-052f-4ccd-ad94-1a7d775adf3c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:35.323346 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-16765887-052f-4ccd-ad94-1a7d775adf3c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:35.346793 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-16765887-052f-4ccd-ad94-1a7d775adf3c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Getting quotas for project 4c597b767cad4ce288fa65d68c5eaff5. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:47:35.350851 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.quota [None req-16765887-052f-4ccd-ad94-1a7d775adf3c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Getting quotas for user 79cca3fb8e6840e688fddecdbce20f1c and project 4c597b767cad4ce288fa65d68c5eaff5. Resources: {'ram', 'instances', 'cores'} {{(pid=118462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:47:35.412003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-16765887-052f-4ccd-ad94-1a7d775adf3c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Going to run 1 instances... {{(pid=118462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:47:35.414164 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-16765887-052f-4ccd-ad94-1a7d775adf3c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b1ad720b-1d5d-434b-91d8-772162361cd6',volume_size=None,volume_type=None)] {{(pid=118462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:47:36.284568 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-16765887-052f-4ccd-ad94-1a7d775adf3c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.529892 Jul 14 14:47:36.297006 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 545/1097] 10.222.0.93 () {60 vars in 1146 bytes} [Thu Jul 14 14:47:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:47:36.297156 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:36.297156 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=68 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:36.300111 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-53e20ba6-0c16-48c6-9896-10afb11a0575 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:36.301020 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-53e20ba6-0c16-48c6-9896-10afb11a0575 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:36.355580 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-53e20ba6-0c16-48c6-9896-10afb11a0575 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:36.363679 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-53e20ba6-0c16-48c6-9896-10afb11a0575 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1093 microversion: 2.1 time: 0.071904 Jul 14 14:47:36.364234 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 553/1098] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:36 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:37.384149 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-6648025b-3116-42fa-b238-05614ad97a84 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:37.384762 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-6648025b-3116-42fa-b238-05614ad97a84 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:37.443233 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-6648025b-3116-42fa-b238-05614ad97a84 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:37.451174 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-6648025b-3116-42fa-b238-05614ad97a84 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1093 microversion: 2.1 time: 0.071366 Jul 14 14:47:37.451760 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 546/1099] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:37 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:38.469055 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d625d0e0-57cb-470e-9aec-3777824623ef tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:38.470955 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d625d0e0-57cb-470e-9aec-3777824623ef tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:38.484755 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d625d0e0-57cb-470e-9aec-3777824623ef tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:38.485596 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d625d0e0-57cb-470e-9aec-3777824623ef tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:38.487031 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d625d0e0-57cb-470e-9aec-3777824623ef tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:38.487774 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d625d0e0-57cb-470e-9aec-3777824623ef tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:38.557287 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d625d0e0-57cb-470e-9aec-3777824623ef tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:38.565957 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d625d0e0-57cb-470e-9aec-3777824623ef tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1143 microversion: 2.1 time: 0.100925 Jul 14 14:47:38.571912 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 554/1100] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:38 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1143 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:39.583395 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-375840e8-4346-47b5-b869-d94efe630b6e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:39.584003 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-375840e8-4346-47b5-b869-d94efe630b6e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:39.591468 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-375840e8-4346-47b5-b869-d94efe630b6e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:39.591922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-375840e8-4346-47b5-b869-d94efe630b6e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:39.592681 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-375840e8-4346-47b5-b869-d94efe630b6e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:39.593117 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-375840e8-4346-47b5-b869-d94efe630b6e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:39.655967 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-375840e8-4346-47b5-b869-d94efe630b6e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:39.665076 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-375840e8-4346-47b5-b869-d94efe630b6e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1191 microversion: 2.1 time: 0.086207 Jul 14 14:47:39.665830 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 547/1101] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:39 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:40.684817 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-65038db8-7958-486c-b1ed-87a5b5ed991c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:40.685985 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-65038db8-7958-486c-b1ed-87a5b5ed991c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:40.695108 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-65038db8-7958-486c-b1ed-87a5b5ed991c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:40.695778 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-65038db8-7958-486c-b1ed-87a5b5ed991c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:40.696743 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-65038db8-7958-486c-b1ed-87a5b5ed991c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:40.697326 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-65038db8-7958-486c-b1ed-87a5b5ed991c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:40.862726 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-65038db8-7958-486c-b1ed-87a5b5ed991c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:40.870900 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-65038db8-7958-486c-b1ed-87a5b5ed991c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1276 microversion: 2.1 time: 0.191699 Jul 14 14:47:40.871968 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 555/1102] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:40 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1276 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:41.835969 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-5f431cbb-9672-47a4-ad6f-16479afd9e76 req-745dbdca-e78b-4ef9-8204-6dfefa302e60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa44b75-fb51-4a79-828e-be7187040088", "tag": "88cfac74-154c-434b-8a1d-aaf3d5ed5348"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:41.849103 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-5f431cbb-9672-47a4-ad6f-16479afd9e76 req-745dbdca-e78b-4ef9-8204-6dfefa302e60 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:41.849950 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-5f431cbb-9672-47a4-ad6f-16479afd9e76 req-745dbdca-e78b-4ef9-8204-6dfefa302e60 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:41.867338 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-5f431cbb-9672-47a4-ad6f-16479afd9e76 req-745dbdca-e78b-4ef9-8204-6dfefa302e60 service nova] Creating event network-changed:88cfac74-154c-434b-8a1d-aaf3d5ed5348 for instance ffa44b75-fb51-4a79-828e-be7187040088 on hv-cinder-79987 Jul 14 14:47:41.877667 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-5f431cbb-9672-47a4-ad6f-16479afd9e76 req-745dbdca-e78b-4ef9-8204-6dfefa302e60 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128869 Jul 14 14:47:41.879664 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 548/1103] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:41.894271 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-7a10d34d-a4b5-4050-a2ca-920c746f9fe1 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:41.894983 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-7a10d34d-a4b5-4050-a2ca-920c746f9fe1 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:41.902908 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7a10d34d-a4b5-4050-a2ca-920c746f9fe1 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:41.903353 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7a10d34d-a4b5-4050-a2ca-920c746f9fe1 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:41.904330 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7a10d34d-a4b5-4050-a2ca-920c746f9fe1 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:41.904875 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7a10d34d-a4b5-4050-a2ca-920c746f9fe1 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:42.079852 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7a10d34d-a4b5-4050-a2ca-920c746f9fe1 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:42.089621 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-7a10d34d-a4b5-4050-a2ca-920c746f9fe1 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1276 microversion: 2.1 time: 0.199814 Jul 14 14:47:42.090244 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 556/1104] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:41 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1276 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:43.108128 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-204e2032-bfa9-4448-b8e9-3f5ce158edc4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:43.109088 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-204e2032-bfa9-4448-b8e9-3f5ce158edc4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:43.116778 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-204e2032-bfa9-4448-b8e9-3f5ce158edc4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:43.117425 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-204e2032-bfa9-4448-b8e9-3f5ce158edc4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:43.118255 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-204e2032-bfa9-4448-b8e9-3f5ce158edc4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:43.118726 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-204e2032-bfa9-4448-b8e9-3f5ce158edc4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:43.265558 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-204e2032-bfa9-4448-b8e9-3f5ce158edc4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:43.273511 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-204e2032-bfa9-4448-b8e9-3f5ce158edc4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1264 microversion: 2.1 time: 0.170159 Jul 14 14:47:43.274193 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 549/1105] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:43 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:44.291227 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-7807b990-73f2-4994-982b-89abe913cf5f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:44.291971 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-7807b990-73f2-4994-982b-89abe913cf5f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:44.298507 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7807b990-73f2-4994-982b-89abe913cf5f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:44.298950 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7807b990-73f2-4994-982b-89abe913cf5f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:44.299722 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7807b990-73f2-4994-982b-89abe913cf5f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:44.300154 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-7807b990-73f2-4994-982b-89abe913cf5f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:44.693953 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-7807b990-73f2-4994-982b-89abe913cf5f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:44.702632 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-7807b990-73f2-4994-982b-89abe913cf5f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1264 microversion: 2.1 time: 0.415722 Jul 14 14:47:44.703212 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 557/1106] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:44 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1264 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:45.722266 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-a713ec59-e07f-4365-a01f-07e16a01f766 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:45.722871 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-a713ec59-e07f-4365-a01f-07e16a01f766 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:45.725814 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=2 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:45.731142 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a713ec59-e07f-4365-a01f-07e16a01f766 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:45.731580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a713ec59-e07f-4365-a01f-07e16a01f766 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:45.732584 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a713ec59-e07f-4365-a01f-07e16a01f766 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:45.732835 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-a713ec59-e07f-4365-a01f-07e16a01f766 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:45.898414 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-a713ec59-e07f-4365-a01f-07e16a01f766 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:45.906641 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-a713ec59-e07f-4365-a01f-07e16a01f766 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1264 microversion: 2.1 time: 0.188380 Jul 14 14:47:45.907234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 550/1107] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:45 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:46.925213 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell0:SELECT=2 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:46.983993 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-ef732996-fc90-49fb-9ae4-d783d97af0fe tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:46.984602 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-ef732996-fc90-49fb-9ae4-d783d97af0fe tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:46.990708 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ef732996-fc90-49fb-9ae4-d783d97af0fe tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:46.991147 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ef732996-fc90-49fb-9ae4-d783d97af0fe tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:46.991899 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ef732996-fc90-49fb-9ae4-d783d97af0fe tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:46.992326 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-ef732996-fc90-49fb-9ae4-d783d97af0fe tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:47.137512 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-ef732996-fc90-49fb-9ae4-d783d97af0fe tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:47.145847 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-ef732996-fc90-49fb-9ae4-d783d97af0fe tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1264 microversion: 2.1 time: 0.226059 Jul 14 14:47:47.146437 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 558/1108] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:46 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1264 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:48.163434 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-c1d7ed6b-b3eb-4276-983a-54d5f9aae66e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:48.164046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-c1d7ed6b-b3eb-4276-983a-54d5f9aae66e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:48.166417 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell0:SELECT=8 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:48.171848 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c1d7ed6b-b3eb-4276-983a-54d5f9aae66e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:48.172955 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c1d7ed6b-b3eb-4276-983a-54d5f9aae66e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:48.182478 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c1d7ed6b-b3eb-4276-983a-54d5f9aae66e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:48.182478 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-c1d7ed6b-b3eb-4276-983a-54d5f9aae66e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:48.325001 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-c1d7ed6b-b3eb-4276-983a-54d5f9aae66e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:48.333163 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-c1d7ed6b-b3eb-4276-983a-54d5f9aae66e tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1264 microversion: 2.1 time: 0.173658 Jul 14 14:47:48.333830 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 551/1109] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:48 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:49.351073 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-cc61a84e-b90d-4ab1-873a-37b918084d0d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:49.351674 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-cc61a84e-b90d-4ab1-873a-37b918084d0d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:49.358728 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cc61a84e-b90d-4ab1-873a-37b918084d0d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:49.359175 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cc61a84e-b90d-4ab1-873a-37b918084d0d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:49.360453 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cc61a84e-b90d-4ab1-873a-37b918084d0d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:49.360885 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-cc61a84e-b90d-4ab1-873a-37b918084d0d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:49.515583 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-cc61a84e-b90d-4ab1-873a-37b918084d0d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:49.523141 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-cc61a84e-b90d-4ab1-873a-37b918084d0d tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1264 microversion: 2.1 time: 0.176034 Jul 14 14:47:49.523687 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 559/1110] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:49 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:50.541026 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-42a79d08-c6d5-4259-aed0-0d0e1538582c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:50.541580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-42a79d08-c6d5-4259-aed0-0d0e1538582c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:50.548653 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-42a79d08-c6d5-4259-aed0-0d0e1538582c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:50.549096 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-42a79d08-c6d5-4259-aed0-0d0e1538582c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:50.549874 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-42a79d08-c6d5-4259-aed0-0d0e1538582c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:50.550305 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-42a79d08-c6d5-4259-aed0-0d0e1538582c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:50.688853 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-42a79d08-c6d5-4259-aed0-0d0e1538582c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:50.696401 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-42a79d08-c6d5-4259-aed0-0d0e1538582c tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1264 microversion: 2.1 time: 0.159618 Jul 14 14:47:50.697657 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 552/1111] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:50 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:51.715097 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-d7211ebc-f8eb-4d88-a0b8-6bdd2b4d56a5 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:51.715956 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-d7211ebc-f8eb-4d88-a0b8-6bdd2b4d56a5 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:51.722683 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d7211ebc-f8eb-4d88-a0b8-6bdd2b4d56a5 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:51.723062 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d7211ebc-f8eb-4d88-a0b8-6bdd2b4d56a5 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:51.723834 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d7211ebc-f8eb-4d88-a0b8-6bdd2b4d56a5 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:51.724272 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-d7211ebc-f8eb-4d88-a0b8-6bdd2b4d56a5 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:51.876801 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-d7211ebc-f8eb-4d88-a0b8-6bdd2b4d56a5 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:51.880521 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-d7211ebc-f8eb-4d88-a0b8-6bdd2b4d56a5 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1264 microversion: 2.1 time: 0.169337 Jul 14 14:47:51.881111 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 560/1112] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:51 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:52.562240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-09f95838-f8ee-4071-a40c-3bcc1f989361 req-0ad129b4-7175-4704-8877-ec4b25e7be2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa44b75-fb51-4a79-828e-be7187040088", "name": "network-vif-plugged", "status": "completed", "tag": "88cfac74-154c-434b-8a1d-aaf3d5ed5348"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:52.572755 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-09f95838-f8ee-4071-a40c-3bcc1f989361 req-0ad129b4-7175-4704-8877-ec4b25e7be2e service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:52.573125 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-09f95838-f8ee-4071-a40c-3bcc1f989361 req-0ad129b4-7175-4704-8877-ec4b25e7be2e service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:52.587794 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-09f95838-f8ee-4071-a40c-3bcc1f989361 req-0ad129b4-7175-4704-8877-ec4b25e7be2e service nova] Creating event network-vif-plugged:88cfac74-154c-434b-8a1d-aaf3d5ed5348 for instance ffa44b75-fb51-4a79-828e-be7187040088 on hv-cinder-79987 Jul 14 14:47:52.593133 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-09f95838-f8ee-4071-a40c-3bcc1f989361 req-0ad129b4-7175-4704-8877-ec4b25e7be2e service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035625 Jul 14 14:47:52.594506 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 553/1113] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:52.899388 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-5e5817e9-7cfd-468d-9f14-ee03f8451999 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:52.899988 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-5e5817e9-7cfd-468d-9f14-ee03f8451999 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:52.907197 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5e5817e9-7cfd-468d-9f14-ee03f8451999 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:52.907649 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5e5817e9-7cfd-468d-9f14-ee03f8451999 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:52.908414 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5e5817e9-7cfd-468d-9f14-ee03f8451999 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:52.908846 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-5e5817e9-7cfd-468d-9f14-ee03f8451999 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:53.079130 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-5e5817e9-7cfd-468d-9f14-ee03f8451999 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:53.087790 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-5e5817e9-7cfd-468d-9f14-ee03f8451999 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1264 microversion: 2.1 time: 0.192388 Jul 14 14:47:53.088366 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 561/1114] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:52 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:54.105240 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-b61a9b00-7df4-4707-bc4a-9b0d0f4fa8dd tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:54.105979 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-b61a9b00-7df4-4707-bc4a-9b0d0f4fa8dd tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:54.113376 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b61a9b00-7df4-4707-bc4a-9b0d0f4fa8dd tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:54.113761 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b61a9b00-7df4-4707-bc4a-9b0d0f4fa8dd tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:54.114551 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b61a9b00-7df4-4707-bc4a-9b0d0f4fa8dd tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:54.114981 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-b61a9b00-7df4-4707-bc4a-9b0d0f4fa8dd tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:54.261962 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-b61a9b00-7df4-4707-bc4a-9b0d0f4fa8dd tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:54.269663 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-b61a9b00-7df4-4707-bc4a-9b0d0f4fa8dd tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1264 microversion: 2.1 time: 0.168899 Jul 14 14:47:54.270284 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 554/1115] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:54 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:55.286498 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-1e90774f-699d-4f66-af07-1a468f048181 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:55.287102 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-1e90774f-699d-4f66-af07-1a468f048181 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:55.294130 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1e90774f-699d-4f66-af07-1a468f048181 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:55.294527 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1e90774f-699d-4f66-af07-1a468f048181 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:55.295300 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1e90774f-699d-4f66-af07-1a468f048181 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:55.295725 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-1e90774f-699d-4f66-af07-1a468f048181 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:55.432609 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-1e90774f-699d-4f66-af07-1a468f048181 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:55.440278 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-1e90774f-699d-4f66-af07-1a468f048181 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1450 microversion: 2.1 time: 0.157730 Jul 14 14:47:55.440843 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 562/1116] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:55 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:55.456243 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f25abbbf-6b03-4202-b23f-15cb792fcae4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:55.456850 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f25abbbf-6b03-4202-b23f-15cb792fcae4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:55.465372 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f25abbbf-6b03-4202-b23f-15cb792fcae4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:55.465840 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f25abbbf-6b03-4202-b23f-15cb792fcae4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:55.466609 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f25abbbf-6b03-4202-b23f-15cb792fcae4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:55.467046 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f25abbbf-6b03-4202-b23f-15cb792fcae4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:55.606464 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f25abbbf-6b03-4202-b23f-15cb792fcae4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:55.614380 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f25abbbf-6b03-4202-b23f-15cb792fcae4 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1450 microversion: 2.1 time: 0.162164 Jul 14 14:47:55.614952 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 555/1117] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:55 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:57.774798 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-8238df51-2cda-4d7e-958b-817f6195d512 req-6d5fb760-44bb-4668-b57f-465017b42aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa44b75-fb51-4a79-828e-be7187040088", "tag": "88cfac74-154c-434b-8a1d-aaf3d5ed5348"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:57.783168 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-8238df51-2cda-4d7e-958b-817f6195d512 req-6d5fb760-44bb-4668-b57f-465017b42aa8 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:57.783673 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-8238df51-2cda-4d7e-958b-817f6195d512 req-6d5fb760-44bb-4668-b57f-465017b42aa8 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:57.795502 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-8238df51-2cda-4d7e-958b-817f6195d512 req-6d5fb760-44bb-4668-b57f-465017b42aa8 service nova] Creating event network-changed:88cfac74-154c-434b-8a1d-aaf3d5ed5348 for instance ffa44b75-fb51-4a79-828e-be7187040088 on hv-cinder-79987 Jul 14 14:47:57.800525 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-8238df51-2cda-4d7e-958b-817f6195d512 req-6d5fb760-44bb-4668-b57f-465017b42aa8 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089167 Jul 14 14:47:57.801243 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 563/1118] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:16.138933 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 14:49:16.139716 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Thu Jul 14 14:49:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 14:49:27.214681 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:27.215987 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG dbcounter [-] [118462] Writing DB stats nova_cell1:SELECT=48 {{(pid=118462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:27.217588 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_api:SELECT=24 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:27.218597 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG dbcounter [-] [118461] Writing DB stats nova_cell1:SELECT=56 {{(pid=118461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:27.221278 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f1f47e89-6a9d-421c-a716-a7397a0c961f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:27.221793 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f1f47e89-6a9d-421c-a716-a7397a0c961f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:27.227610 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-13fac4cc-7c62-47ed-b890-4cd22d446a23 req-0c0c2ee2-2626-4714-822e-a42c49ae17b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffa44b75-fb51-4a79-828e-be7187040088", "tag": "88cfac74-154c-434b-8a1d-aaf3d5ed5348"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:27.228090 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f1f47e89-6a9d-421c-a716-a7397a0c961f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:27.228681 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f1f47e89-6a9d-421c-a716-a7397a0c961f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:27.229470 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f1f47e89-6a9d-421c-a716-a7397a0c961f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:27.229934 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f1f47e89-6a9d-421c-a716-a7397a0c961f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:27.234888 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-13fac4cc-7c62-47ed-b890-4cd22d446a23 req-0c0c2ee2-2626-4714-822e-a42c49ae17b1 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:27.235425 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-13fac4cc-7c62-47ed-b890-4cd22d446a23 req-0c0c2ee2-2626-4714-822e-a42c49ae17b1 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:27.249505 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-13fac4cc-7c62-47ed-b890-4cd22d446a23 req-0c0c2ee2-2626-4714-822e-a42c49ae17b1 service nova] Creating event network-changed:88cfac74-154c-434b-8a1d-aaf3d5ed5348 for instance ffa44b75-fb51-4a79-828e-be7187040088 on hv-cinder-79987 Jul 14 14:49:27.255007 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-13fac4cc-7c62-47ed-b890-4cd22d446a23 req-0c0c2ee2-2626-4714-822e-a42c49ae17b1 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040104 Jul 14 14:49:27.255692 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 564/1119] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:27.264445 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f1f47e89-6a9d-421c-a716-a7397a0c961f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Going to try to terminate instance {{(pid=118462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:49:27.655741 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f1f47e89-6a9d-421c-a716-a7397a0c961f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "DELETE /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 204 len: 0 microversion: 2.1 time: 0.442175 Jul 14 14:49:27.656706 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 556/1120] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:27 2022] DELETE /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:49:27.665642 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a1394365-b080-49c6-b0be-e946a7513d67 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:27.666493 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a1394365-b080-49c6-b0be-e946a7513d67 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:27.673488 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a1394365-b080-49c6-b0be-e946a7513d67 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:27.673988 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a1394365-b080-49c6-b0be-e946a7513d67 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:27.674764 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a1394365-b080-49c6-b0be-e946a7513d67 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:27.675200 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a1394365-b080-49c6-b0be-e946a7513d67 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:27.818129 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-a1394365-b080-49c6-b0be-e946a7513d67 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:27.826089 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a1394365-b080-49c6-b0be-e946a7513d67 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1574 microversion: 2.1 time: 0.164955 Jul 14 14:49:27.827275 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 565/1121] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:27 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:28.846709 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-e3dd9539-8f16-43a7-882b-e7c2baf5e288 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:28.847591 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-e3dd9539-8f16-43a7-882b-e7c2baf5e288 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:28.854783 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e3dd9539-8f16-43a7-882b-e7c2baf5e288 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:28.855230 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e3dd9539-8f16-43a7-882b-e7c2baf5e288 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:28.856038 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e3dd9539-8f16-43a7-882b-e7c2baf5e288 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:28.856466 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-e3dd9539-8f16-43a7-882b-e7c2baf5e288 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:29.007119 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-e3dd9539-8f16-43a7-882b-e7c2baf5e288 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:29.014985 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-e3dd9539-8f16-43a7-882b-e7c2baf5e288 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1574 microversion: 2.1 time: 0.174112 Jul 14 14:49:29.015574 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 557/1122] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:28 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:29.731642 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [req-7c4a59cd-f6fe-41f9-89f7-9fda526e6fb4 req-1a650ea2-636a-483d-90bc-2c90a097e37f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffa44b75-fb51-4a79-828e-be7187040088", "name": "network-vif-deleted", "tag": "88cfac74-154c-434b-8a1d-aaf3d5ed5348"}]} {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:29.741638 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-7c4a59cd-f6fe-41f9-89f7-9fda526e6fb4 req-1a650ea2-636a-483d-90bc-2c90a097e37f service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:29.742081 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [req-7c4a59cd-f6fe-41f9-89f7-9fda526e6fb4 req-1a650ea2-636a-483d-90bc-2c90a097e37f service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:29.754537 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.compute.server_external_events [req-7c4a59cd-f6fe-41f9-89f7-9fda526e6fb4 req-1a650ea2-636a-483d-90bc-2c90a097e37f service nova] Creating event network-vif-deleted:88cfac74-154c-434b-8a1d-aaf3d5ed5348 for instance ffa44b75-fb51-4a79-828e-be7187040088 on hv-cinder-79987 Jul 14 14:49:29.759914 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [req-7c4a59cd-f6fe-41f9-89f7-9fda526e6fb4 req-1a650ea2-636a-483d-90bc-2c90a097e37f service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032121 Jul 14 14:49:29.763441 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 566/1123] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:30.036149 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f708768c-f2a5-4a53-81f4-2bf8764655f5 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:30.041958 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f708768c-f2a5-4a53-81f4-2bf8764655f5 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:30.043900 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f708768c-f2a5-4a53-81f4-2bf8764655f5 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:30.044554 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f708768c-f2a5-4a53-81f4-2bf8764655f5 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:30.045798 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f708768c-f2a5-4a53-81f4-2bf8764655f5 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:30.046234 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f708768c-f2a5-4a53-81f4-2bf8764655f5 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:30.113439 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-f708768c-f2a5-4a53-81f4-2bf8764655f5 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:30.122959 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f708768c-f2a5-4a53-81f4-2bf8764655f5 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1224 microversion: 2.1 time: 0.090963 Jul 14 14:49:30.123755 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 558/1124] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:30 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:49:31.141220 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-986e971f-18ab-45a4-b337-05249f871860 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:31.141980 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-986e971f-18ab-45a4-b337-05249f871860 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:31.148779 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-986e971f-18ab-45a4-b337-05249f871860 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:31.149415 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-986e971f-18ab-45a4-b337-05249f871860 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:31.150364 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-986e971f-18ab-45a4-b337-05249f871860 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:31.150501 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-986e971f-18ab-45a4-b337-05249f871860 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:31.185582 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-986e971f-18ab-45a4-b337-05249f871860 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:31.186030 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-986e971f-18ab-45a4-b337-05249f871860 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:31.186486 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.objects.instance [None req-986e971f-18ab-45a4-b337-05249f871860 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lazy-loading 'fault' on Instance uuid ffa44b75-fb51-4a79-828e-be7187040088 {{(pid=118461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:49:31.236329 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-986e971f-18ab-45a4-b337-05249f871860 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:31.239463 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-986e971f-18ab-45a4-b337-05249f871860 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 200 len: 1229 microversion: 2.1 time: 0.103331 Jul 14 14:49:31.240236 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 567/1125] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:31 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:32.257187 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f14d8efc-8a07-44d1-a7f7-39b9f17f0b52 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:32.257839 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-f14d8efc-8a07-44d1-a7f7-39b9f17f0b52 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: ffa44b75-fb51-4a79-828e-be7187040088] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:32.264524 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f14d8efc-8a07-44d1-a7f7-39b9f17f0b52 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:32.264965 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f14d8efc-8a07-44d1-a7f7-39b9f17f0b52 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:32.265732 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f14d8efc-8a07-44d1-a7f7-39b9f17f0b52 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:32.266196 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-f14d8efc-8a07-44d1-a7f7-39b9f17f0b52 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:32.281144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-f14d8efc-8a07-44d1-a7f7-39b9f17f0b52 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] HTTP exception thrown: Instance ffa44b75-fb51-4a79-828e-be7187040088 could not be found. Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f14d8efc-8a07-44d1-a7f7-39b9f17f0b52 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Request method failure captured: Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 HTTP/1.1 Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0Ctf5O4f2gkpIGOKzWxJuIypHGw1QlZSpAqBd5SNTZTt7YXJhBmupYGjRryobS0yPHCYoN25mIXbfTmIDlYpak9SzJaCYPRZaEPIA5Y1WNAIVo8MTS39MUHo9BGTOOw9j1byz7gsr6uvYtWS5LOoclcXbmoYg6WHF4yJ8Yx8IUBoWVA Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: 4c597b767cad4ce288fa65d68c5eaff5 Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-TestVolumeBootPattern-624950949 Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:49:32.282920 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:49:32.285143 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:49:32.285143 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-TestVolumeBootPattern-624950949 Jul 14 14:49:32.285143 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: 4c597b767cad4ce288fa65d68c5eaff5 Jul 14 14:49:32.285143 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-TestVolumeBootPattern-624950949 Jul 14 14:49:32.285143 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-TestVolumeBootPattern-624950949-project Jul 14 14:49:32.285143 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:49:32.285143 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:49:32.285143 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 79cca3fb8e6840e688fddecdbce20f1c Jul 14 14:49:32.285143 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-TestVolumeBootPattern-624950949-project Jul 14 14:49:32.285143 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:49:32.285143 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance ffa44b75-fb51-4a79-828e-be7187040088 could not be found. Jul 14 14:49:32.285143 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': 'ffa44b75-fb51-4a79-828e-be7187040088'} Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffa44b75-fb51-4a79-828e-be7187040088 could not be found. Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:32.286245 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:32.287973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:32.287973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:49:32.287973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:32.287973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:49:32.287973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:32.287973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:32.287973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:32.287973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffa44b75-fb51-4a79-828e-be7187040088 could not be found. Jul 14 14:49:32.287973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:49:32.287973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:32.287973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:49:32.287973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:32.287973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:32.287973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:32.287973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:32.287973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:32.287973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffa44b75-fb51-4a79-828e-be7187040088 could not be found. Jul 14 14:49:32.287973 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:49:32.289565 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-f14d8efc-8a07-44d1-a7f7-39b9f17f0b52 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Returning 404 to user: Instance ffa44b75-fb51-4a79-828e-be7187040088 could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:32.289565 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-f14d8efc-8a07-44d1-a7f7-39b9f17f0b52 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088" status: 404 len: 111 microversion: 2.1 time: 0.031384 Jul 14 14:49:32.289565 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 559/1126] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:32 2022] GET /compute/v2.1/servers/ffa44b75-fb51-4a79-828e-be7187040088 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:35.946868 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-86a88df8-dabb-41c9-9408-a97e703351fc tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:35.947509 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-86a88df8-dabb-41c9-9408-a97e703351fc tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:35.948725 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-340893b7-4983-44b2-a1c8-f60ad87a685e req-83b12461-fac4-4215-b230-10c1c3ad4727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98e910d5-d587-4a9c-89eb-90c2bc660aa4", "tag": "9b90d953-cb8d-4913-b04b-2b2afacd65fd"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:35.954447 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-86a88df8-dabb-41c9-9408-a97e703351fc tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:35.954891 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-86a88df8-dabb-41c9-9408-a97e703351fc tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:35.955654 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-86a88df8-dabb-41c9-9408-a97e703351fc tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:35.956571 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-86a88df8-dabb-41c9-9408-a97e703351fc tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:35.958860 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-340893b7-4983-44b2-a1c8-f60ad87a685e req-83b12461-fac4-4215-b230-10c1c3ad4727 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:35.958860 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-340893b7-4983-44b2-a1c8-f60ad87a685e req-83b12461-fac4-4215-b230-10c1c3ad4727 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:35.971912 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-340893b7-4983-44b2-a1c8-f60ad87a685e req-83b12461-fac4-4215-b230-10c1c3ad4727 service nova] Creating event network-changed:9b90d953-cb8d-4913-b04b-2b2afacd65fd for instance 98e910d5-d587-4a9c-89eb-90c2bc660aa4 on hv-cinder-79987 Jul 14 14:49:35.978030 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-340893b7-4983-44b2-a1c8-f60ad87a685e req-83b12461-fac4-4215-b230-10c1c3ad4727 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032892 Jul 14 14:49:35.978765 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 560/1127] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:49:35.995977 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-86a88df8-dabb-41c9-9408-a97e703351fc tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Going to try to terminate instance {{(pid=118461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:49:36.415821 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-86a88df8-dabb-41c9-9408-a97e703351fc tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "DELETE /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 204 len: 0 microversion: 2.1 time: 0.472908 Jul 14 14:49:36.416749 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 568/1128] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:35 2022] DELETE /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:49:36.425901 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-eb6b4978-ebcf-45ac-ac28-d87633195254 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:36.426917 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-eb6b4978-ebcf-45ac-ac28-d87633195254 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:36.434196 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-eb6b4978-ebcf-45ac-ac28-d87633195254 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:36.434656 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-eb6b4978-ebcf-45ac-ac28-d87633195254 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:36.435723 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-eb6b4978-ebcf-45ac-ac28-d87633195254 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:36.436197 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-eb6b4978-ebcf-45ac-ac28-d87633195254 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:36.592231 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.policy [None req-eb6b4978-ebcf-45ac-ac28-d87633195254 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118462) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:36.601875 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-eb6b4978-ebcf-45ac-ac28-d87633195254 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 200 len: 1573 microversion: 2.1 time: 0.180071 Jul 14 14:49:36.602487 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 561/1129] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:36 2022] GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 1573 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:37.619714 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-3ef22666-dd94-4d27-99f8-af3be59697bb tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:37.620353 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-3ef22666-dd94-4d27-99f8-af3be59697bb tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:37.627127 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3ef22666-dd94-4d27-99f8-af3be59697bb tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:37.634943 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3ef22666-dd94-4d27-99f8-af3be59697bb tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:37.634943 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3ef22666-dd94-4d27-99f8-af3be59697bb tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:37.634943 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-3ef22666-dd94-4d27-99f8-af3be59697bb tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:37.787932 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-3ef22666-dd94-4d27-99f8-af3be59697bb tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:37.796210 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-3ef22666-dd94-4d27-99f8-af3be59697bb tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 200 len: 1573 microversion: 2.1 time: 0.181344 Jul 14 14:49:37.796779 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 569/1130] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:37 2022] GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 1573 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:38.547037 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [req-c9bbbd35-8aa7-43b8-b209-291bece6e9e6 req-ba874380-504d-4149-a31f-6dbc4ca013b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98e910d5-d587-4a9c-89eb-90c2bc660aa4", "name": "network-vif-deleted", "tag": "9b90d953-cb8d-4913-b04b-2b2afacd65fd"}]} {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:38.556223 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-c9bbbd35-8aa7-43b8-b209-291bece6e9e6 req-ba874380-504d-4149-a31f-6dbc4ca013b6 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:38.556682 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [req-c9bbbd35-8aa7-43b8-b209-291bece6e9e6 req-ba874380-504d-4149-a31f-6dbc4ca013b6 service nova] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:38.568808 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.compute.server_external_events [req-c9bbbd35-8aa7-43b8-b209-291bece6e9e6 req-ba874380-504d-4149-a31f-6dbc4ca013b6 service nova] Creating event network-vif-deleted:9b90d953-cb8d-4913-b04b-2b2afacd65fd for instance 98e910d5-d587-4a9c-89eb-90c2bc660aa4 on hv-cinder-79987 Jul 14 14:49:38.574438 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [req-c9bbbd35-8aa7-43b8-b209-291bece6e9e6 req-ba874380-504d-4149-a31f-6dbc4ca013b6 service nova] 10.222.0.93 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031073 Jul 14 14:49:38.575880 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 562/1131] 10.222.0.93 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:38.812628 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-befeec56-cc50-4a81-9acc-6f7fa7d41e97 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:38.813230 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-befeec56-cc50-4a81-9acc-6f7fa7d41e97 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:38.820192 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-befeec56-cc50-4a81-9acc-6f7fa7d41e97 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:38.834947 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-befeec56-cc50-4a81-9acc-6f7fa7d41e97 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:38.834947 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-befeec56-cc50-4a81-9acc-6f7fa7d41e97 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:38.834947 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-befeec56-cc50-4a81-9acc-6f7fa7d41e97 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:38.891163 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.policy [None req-befeec56-cc50-4a81-9acc-6f7fa7d41e97 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79cca3fb8e6840e688fddecdbce20f1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c597b767cad4ce288fa65d68c5eaff5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118461) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:38.900620 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-befeec56-cc50-4a81-9acc-6f7fa7d41e97 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 200 len: 1223 microversion: 2.1 time: 0.091389 Jul 14 14:49:38.901206 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 570/1132] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:38 2022] GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:39.919147 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-1e8b1cc1-1601-418c-9a22-24480c859ba3 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:39.919948 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-1e8b1cc1-1601-418c-9a22-24480c859ba3 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 98e910d5-d587-4a9c-89eb-90c2bc660aa4] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:39.947759 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1e8b1cc1-1601-418c-9a22-24480c859ba3 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:39.947759 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1e8b1cc1-1601-418c-9a22-24480c859ba3 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:39.947759 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1e8b1cc1-1601-418c-9a22-24480c859ba3 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:39.947759 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-1e8b1cc1-1601-418c-9a22-24480c859ba3 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:39.952233 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-1e8b1cc1-1601-418c-9a22-24480c859ba3 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] HTTP exception thrown: Instance 98e910d5-d587-4a9c-89eb-90c2bc660aa4 could not be found. Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-1e8b1cc1-1601-418c-9a22-24480c859ba3 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Request method failure captured: Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 HTTP/1.1 Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0Ctf5O4f2gkpIGOKzWxJuIypHGw1QlZSpAqBd5SNTZTt7YXJhBmupYGjRryobS0yPHCYoN25mIXbfTmIDlYpak9SzJaCYPRZaEPIA5Y1WNAIVo8MTS39MUHo9BGTOOw9j1byz7gsr6uvYtWS5LOoclcXbmoYg6WHF4yJ8Yx8IUBoWVA Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: 4c597b767cad4ce288fa65d68c5eaff5 Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-TestVolumeBootPattern-624950949 Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:49:39.953922 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:49:39.955732 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:49:39.955732 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-TestVolumeBootPattern-624950949 Jul 14 14:49:39.955732 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: 4c597b767cad4ce288fa65d68c5eaff5 Jul 14 14:49:39.955732 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-TestVolumeBootPattern-624950949 Jul 14 14:49:39.955732 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-TestVolumeBootPattern-624950949-project Jul 14 14:49:39.955732 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:49:39.955732 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:49:39.955732 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 79cca3fb8e6840e688fddecdbce20f1c Jul 14 14:49:39.955732 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-TestVolumeBootPattern-624950949-project Jul 14 14:49:39.955732 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:49:39.955732 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 98e910d5-d587-4a9c-89eb-90c2bc660aa4 could not be found. Jul 14 14:49:39.955732 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '98e910d5-d587-4a9c-89eb-90c2bc660aa4'} Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98e910d5-d587-4a9c-89eb-90c2bc660aa4 could not be found. Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:39.957397 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:39.959111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:39.959111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:49:39.959111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:39.959111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:49:39.959111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:39.959111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:39.959111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:39.959111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98e910d5-d587-4a9c-89eb-90c2bc660aa4 could not be found. Jul 14 14:49:39.959111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:49:39.959111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:39.959111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:49:39.959111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:39.959111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:39.959111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:39.959111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:39.959111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:39.959111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98e910d5-d587-4a9c-89eb-90c2bc660aa4 could not be found. Jul 14 14:49:39.959111 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:49:39.960913 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-1e8b1cc1-1601-418c-9a22-24480c859ba3 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Returning 404 to user: Instance 98e910d5-d587-4a9c-89eb-90c2bc660aa4 could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:39.960913 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-1e8b1cc1-1601-418c-9a22-24480c859ba3 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4" status: 404 len: 111 microversion: 2.1 time: 0.040939 Jul 14 14:49:39.960913 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 563/1133] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:39 2022] GET /compute/v2.1/servers/98e910d5-d587-4a9c-89eb-90c2bc660aa4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:49:40.513586 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a9576b49-9b5e-4d1b-9bf9-fbbc20b41be2 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:40.519811 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.compute.api [None req-a9576b49-9b5e-4d1b-9bf9-fbbc20b41be2 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118461) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:40.520674 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a9576b49-9b5e-4d1b-9bf9-fbbc20b41be2 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:40.521149 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a9576b49-9b5e-4d1b-9bf9-fbbc20b41be2 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:40.521940 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a9576b49-9b5e-4d1b-9bf9-fbbc20b41be2 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:40.522364 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG oslo_concurrency.lockutils [None req-a9576b49-9b5e-4d1b-9bf9-fbbc20b41be2 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:40.538951 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.wsgi [None req-a9576b49-9b5e-4d1b-9bf9-fbbc20b41be2 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] HTTP exception thrown: Instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 could not be found. Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a9576b49-9b5e-4d1b-9bf9-fbbc20b41be2 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Request method failure captured: Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: request: DELETE /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 HTTP/1.1 Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept: application/json Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Accept-Encoding: identity Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Connection: close Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Length: 0 Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Content-Type: application/json Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Host: 10.222.0.93 Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Openstack-System-Scope: None Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Auth-Token: gAAAAABi0Ctf5O4f2gkpIGOKzWxJuIypHGw1QlZSpAqBd5SNTZTt7YXJhBmupYGjRryobS0yPHCYoN25mIXbfTmIDlYpak9SzJaCYPRZaEPIA5Y1WNAIVo8MTS39MUHo9BGTOOw9j1byz7gsr6uvYtWS5LOoclcXbmoYg6WHF4yJ8Yx8IUBoWVA Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Id: None Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Domain-Name: None Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Identity-Status: Confirmed Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Is-Admin-Project: True Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Id: default Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Domain-Name: Default Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Id: 4c597b767cad4ce288fa65d68c5eaff5 Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Project-Name: tempest-TestVolumeBootPattern-624950949 Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Role: member,reader Jul 14 14:49:40.540589 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Roles: member,reader Jul 14 14:49:40.542361 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:49:40.542361 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant: tempest-TestVolumeBootPattern-624950949 Jul 14 14:49:40.542361 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Id: 4c597b767cad4ce288fa65d68c5eaff5 Jul 14 14:49:40.542361 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-Tenant-Name: tempest-TestVolumeBootPattern-624950949 Jul 14 14:49:40.542361 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User: tempest-TestVolumeBootPattern-624950949-project Jul 14 14:49:40.542361 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Id: default Jul 14 14:49:40.542361 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Domain-Name: Default Jul 14 14:49:40.542361 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Id: 79cca3fb8e6840e688fddecdbce20f1c Jul 14 14:49:40.542361 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: X-User-Name: tempest-TestVolumeBootPattern-624950949-project Jul 14 14:49:40.542361 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: method: > Jul 14 14:49:40.542361 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: exception: Instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 could not be found. Jul 14 14:49:40.542361 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: action_args: {'id': '3c1cd5a3-6756-4243-9e5c-452d92bc8a09'} Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 could not be found. Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:40.547003 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 could not be found. Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 could not be found. Jul 14 14:49:40.548660 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: ERROR nova.api.openstack.wsgi Jul 14 14:49:40.550332 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-a9576b49-9b5e-4d1b-9bf9-fbbc20b41be2 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Returning 404 to user: Instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 could not be found. {{(pid=118461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:40.550332 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-a9576b49-9b5e-4d1b-9bf9-fbbc20b41be2 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "DELETE /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 404 len: 111 microversion: 2.1 time: 0.032338 Jul 14 14:49:40.550332 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 571/1134] 10.222.0.93 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:40 2022] DELETE /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:40.551306 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-4cf9ddb3-2406-489f-95c9-2d223b64d789 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '>' {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:40.551915 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.compute.api [None req-4cf9ddb3-2406-489f-95c9-2d223b64d789 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] [instance: 3c1cd5a3-6756-4243-9e5c-452d92bc8a09] Fetching instance by UUID {{(pid=118462) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:40.557937 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4cf9ddb3-2406-489f-95c9-2d223b64d789 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:40.558385 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4cf9ddb3-2406-489f-95c9-2d223b64d789 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:40.559145 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4cf9ddb3-2406-489f-95c9-2d223b64d789 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:40.559581 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG oslo_concurrency.lockutils [None req-4cf9ddb3-2406-489f-95c9-2d223b64d789 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Lock "ee12dd37-6f17-45ed-8af9-e0df6fe4a856" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:40.573526 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.wsgi [None req-4cf9ddb3-2406-489f-95c9-2d223b64d789 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] HTTP exception thrown: Instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 could not be found. Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-4cf9ddb3-2406-489f-95c9-2d223b64d789 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Request method failure captured: Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: request: GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 HTTP/1.1 Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept: application/json Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Accept-Encoding: identity Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Connection: close Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Length: 0 Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Content-Type: application/json Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Host: 10.222.0.93 Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Openstack-System-Scope: None Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Auth-Token: gAAAAABi0Ctf5O4f2gkpIGOKzWxJuIypHGw1QlZSpAqBd5SNTZTt7YXJhBmupYGjRryobS0yPHCYoN25mIXbfTmIDlYpak9SzJaCYPRZaEPIA5Y1WNAIVo8MTS39MUHo9BGTOOw9j1byz7gsr6uvYtWS5LOoclcXbmoYg6WHF4yJ8Yx8IUBoWVA Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Id: None Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Domain-Name: None Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Identity-Status: Confirmed Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Is-Admin-Project: True Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Id: default Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Domain-Name: Default Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Id: 4c597b767cad4ce288fa65d68c5eaff5 Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Project-Name: tempest-TestVolumeBootPattern-624950949 Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Role: member,reader Jul 14 14:49:40.575089 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Roles: member,reader Jul 14 14:49:40.576782 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.93:8080", "publicURL": "http://10.222.0.93:8080/v1/AUTH_4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/compute/v2/4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/volume/v3/4c597b767cad4ce288fa65d68c5eaff5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.93/placement"}]}] Jul 14 14:49:40.576782 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant: tempest-TestVolumeBootPattern-624950949 Jul 14 14:49:40.576782 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Id: 4c597b767cad4ce288fa65d68c5eaff5 Jul 14 14:49:40.576782 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-Tenant-Name: tempest-TestVolumeBootPattern-624950949 Jul 14 14:49:40.576782 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User: tempest-TestVolumeBootPattern-624950949-project Jul 14 14:49:40.576782 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Id: default Jul 14 14:49:40.576782 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Domain-Name: Default Jul 14 14:49:40.576782 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Id: 79cca3fb8e6840e688fddecdbce20f1c Jul 14 14:49:40.576782 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: X-User-Name: tempest-TestVolumeBootPattern-624950949-project Jul 14 14:49:40.576782 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: method: > Jul 14 14:49:40.576782 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: exception: Instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 could not be found. Jul 14 14:49:40.576782 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: action_args: {'id': '3c1cd5a3-6756-4243-9e5c-452d92bc8a09'} Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: {{(pid=118462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 could not be found. Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:40.580832 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:40.582710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:40.582710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 14:49:40.582710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:40.582710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 14:49:40.582710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:40.582710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:40.582710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:40.582710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 could not be found. Jul 14 14:49:40.582710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:49:40.582710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:40.582710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:49:40.582710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:40.582710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:40.582710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:40.582710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:40.582710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:40.582710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 could not be found. Jul 14 14:49:40.582710 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: ERROR nova.api.openstack.wsgi Jul 14 14:49:40.584584 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: DEBUG nova.api.openstack.wsgi [None req-4cf9ddb3-2406-489f-95c9-2d223b64d789 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Returning 404 to user: Instance 3c1cd5a3-6756-4243-9e5c-452d92bc8a09 could not be found. {{(pid=118462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:40.584584 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO nova.api.openstack.requestlog [None req-4cf9ddb3-2406-489f-95c9-2d223b64d789 tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09" status: 404 len: 111 microversion: 2.1 time: 0.029162 Jul 14 14:49:40.584584 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: [pid: 118462|app: 0|req: 564/1135] 10.222.0.93 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:40 2022] GET /compute/v2.1/servers/3c1cd5a3-6756-4243-9e5c-452d92bc8a09 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:42.167310 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: DEBUG nova.api.openstack.wsgi [None req-af72e548-e306-4226-942a-9a66b73b127f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] Calling method '.version_select at 0x7f415fb62b80>' {{(pid=118461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:42.295392 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO nova.api.openstack.requestlog [None req-af72e548-e306-4226-942a-9a66b73b127f tempest-TestVolumeBootPattern-624950949 tempest-TestVolumeBootPattern-624950949-project] 10.222.0.93 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-503334875" status: 202 len: 0 microversion: 2.1 time: 0.131919 Jul 14 14:49:42.295974 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: [pid: 118461|app: 0|req: 572/1136] 10.222.0.93 () {58 vars in 1259 bytes} [Thu Jul 14 14:49:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-503334875 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:50:42.808445 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 14:50:42.809284 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Thu Jul 14 14:50:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 14:50:53.540842 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 14:50:53.541542 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Thu Jul 14 14:50:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 14:50:53.790405 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 14:50:53.791069 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Thu Jul 14 14:50:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 14:52:36.149842 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 14:52:36.151263 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Thu Jul 14 14:52:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 14:52:51.560349 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 14:52:51.561119 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Thu Jul 14 14:52:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 14:52:54.336744 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 14:52:54.337326 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Thu Jul 14 14:52:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 14:54:02.818144 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 14:54:02.818861 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Thu Jul 14 14:54:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 14:54:13.549575 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 14:54:13.551580 dv-cinder-799871-30-iscsi devstack@n-api.service[118462]: Thu Jul 14 14:54:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 14:54:13.799348 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 14:54:13.800025 dv-cinder-799871-30-iscsi devstack@n-api.service[118461]: Thu Jul 14 14:54:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!